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THE  EFFECTS  OF  SYSTEM  AND  ENVIRONMENTAL  FACTORS  UPON  EXPERIENCED 
PILOT  PERFORMANCE  IN  THE  ADVANCED  SIMULATOR  FOR  PILOT  TRAINING 


L INTRODUCTION 

Problem  Statement  and 
Study  Rationale 

Three  primary  sources  of  cues  used  for  aircraft 
control  are  provided  to  the  pilot  by  cockpit  instru- 
mentation, the  external  visual  scene,  and  vehicle 
motion.  Because  pilot  performance  is  fundamen- 
tally dependent  upon  information  originating  from 
these  sources,  modeling  these  aspects  of  the 
environment  has  been  considered  of  vital 
importance  in  the  design  of  flight  simulators. 
Although  satisfying  simulator  motion  and  visual 
requirements  is  difficult,  the  situation  is  further 
complicated  by  possible  interaction  effects  that 
may  occur  between  them.  The  present  study  is  a 
preliminary  investigation  of  these  phenomena  and 
their  effects  upon  experienced  pilot  performance. 

An  aircraft  in  flight  has  unlimited  freedom  of 
rotational  and  transitional  movement  around  three 
axes.  Rotational  movement  consists  of  roll,  pitch, 
and  yaw,  and  translational  movement  is  comprise 
of  lateral,  longitudinal  and  vertical  displacements. 
State-of-the-art  motion  simulation  devices  (e.g., 
motion  platforms,  G-seats  and  G-suits;  individually 
and  in  combination)  can  generate  movements  in 
these  dimensions  to  various  levels  of  fidelity. 

Visual  scene  generation  also  has  a variety  of 
state-of-the-art  systems  which  have  been  utilized 
to  increase  the  fidelity  of  aircraft  simulators  (e.g.. 
computer  image  generation,  model  board,  and 
calligraphic  displays).  The  fidelity  of  visual 
simulation  may  be  enhanced  by:  (a)  increasing  the 
field  of  view  (FOV),  (b)  expanding  the  edge 
generation  capacity  in  computer  image  generation 
systems,  or  (c)  increasing  the  resolution  and  the 
FOV  of  camera  probes  used  with  model  boards. 
Thus,  the  fidelity  of  the  outside-the-cockpit  visual 
scene,  as  well  as  the  fidelity  of  kinesthetic  cueing 
mechanisms,  must  be  selected  based  upon 
decisions  on  which  essential  cues  are  required  by 
the  pilot  and  in  what  manner  they  should  be 
presented. 

Considering  the  extensive  future  use  of  flight 
simulation  projected  by  the  Air  Force,  infor- 
mation on  simulator  design  requirements  is 
urgently  needed.  To  accomplish  this  task,  ideally, 
a large  factorial  study  could  be  conducted  that 
sunultaneously  addressed  all  facets  of  the  problem. 


Such  an  approach  is  impractical,  and  an  alternative 
strategy  must  be  adopted.  This  study  was  the  first 
of  a series  developed  according  to  this  strategy, 
and  was  intended  to  provide  a “first  look”  at 
certain  major  variables  of  motion,  the  visual 
scene,  and  their  interactions.  The  experiment  was 
limited  to  what  could  be  reasonably  accomplished 
in  light  of  subject  availability,  equipment 
capability,,  and  software  support  development  at 
the  time  of  the  study. 

Study  Objectives 

The  purposes  of  the  study  were: 

First.-  to  assess  the  relative  contribution  of  plat- 
fonn  motion,  G-scat,  and  visual  factors  to  pilot 
perfornance  under  systematically  varied  environ- 
mental conditions.  The  results  of  this  evaluation 
should  begin  to  define  the  variables  and  levels  of 
variables  to  be  utilized  in  follow-on  studies  in  this 
serie;. 

Second,  to  acquire  information  on  the  relation- 
ships between  system  output  measures  and  pilot 
input  measures  as  measured  in  the  Advanced 
Simulator  for  Pilot  Training  (ASPT)  when  flown 
under  specified  tasks,  environmental  conditions, 
and  simulator  configurations. 

Third,  to  evaluate  the  utility  of  economical 
multifactor  designs  to  Air  Force  Human  Resources 
Laboratory,  Flying  Training  Division  (AFHRL/ 
FT)  investigations  into  the  contributions  of 
motion  and  visual  factors  upon  pilot  performance 
in  flight  simulators. 

Background 

Historically,  the  art  of  aircraft  simulation  has 
had  as  one  of  its  foremost  goals  the  development 
of  a maximum  fidelity  device  which  could  provide 
realistic  cues  matching  those  present  in  the 
aircraft.  Currently,  the  major  areas  of  concent  lie 
in  motion  and  visual  cue  generation. 

Movement  and/or  tactile  pressure  is  a necessary 
condition  for  motion  cueing.  One  recent  technical 
approach  for  providing  realistic  sensory  infor- 
mation has  resulted  in  the  creation  of 
pneumatically-driven  seats  (e.g.,  G-seat,  dyna-seat). 
Air-driven  bladders  (located  on  die  seat  and  back 
rest)  inflate  or  deflate  to  provide  die  “seat  of  the 
pants”  cues  wluch  are  normally  expenenced  in 


flight  (Bell,  1974).  Research  pertaining  to  these 
newly  developed  “G-seat”  devices  has  been  under- 
standably limited  due  to  the  small  number  which 
have  been  installed  for  use  on  sophisticated 
simulators.  In  one  study  on  G-seat  cueing,  how- 
ever, performed  by  Taylor  and  Gerber  (1969),  it 
was  reported  that  improvements  in  pilot  training 
resulted  when  “G-seat  forces”  were  provided  in 
conjunction  with  n.otion  cueing. 

Kinesthetic  and  vestibular  cueing  are  also 
provided  by  the  use  of  complex  platform  motion 
systems.  Probably  the  most  recent  and  most 
commonly  used  are  the  synergistic  six  degree  of 
freedom  (DOF)  systems  of  various  excursion 
lengths.  In  the  area  of  platform  motion  simulation, 
researeh  has  been  prolific.  Numerous  investigations 
have  been  directed  towards  determining  which 
DOF  are  required  for  motion  systems  in  particular 
settings  as  well  as  what  levels  of  fidelity  are  needed 
(Bergeron,  1970;  Jacobs,  Williges,  & Roscoe, 
1973).  This  body  of  research,  however,  is  equi- 
vocal, and  findings  have  often  not  been  consistent 
from  study  to  study. 

Much  of  the  research  to  date  has  shown  that 
simulator  motion  produces  improved  pilot- 
perfomiance  in  controlling  tire  simulator  (Borlace, 
1967;  Brown,  Johnson,  & Mungall,  1960).  Addi- 
tionally, Rathert,  Crcer,  and  Sadoff  (1961) 
demonstrated1  that  varying  the  fidelity  of  motion 
cueing  correspondingly  improved  the  pilot’s 
performance  in  the  simulator.  Koonce  (1974) 
investigated  the  effectiveness  of  platform  motion 
using  three  conditions  of  motion  cueing  (i.e.,  no 
motion,  sustained  motion  cueing,  and  washout 
mot'on  cueing).  This  study  also  showed  an  in- 
crease in  pilot  performance  in  the  simulator  when 
motion  cueing  was  present. 

The  evidence  supporting  the  positive  effects  of 
high  fidelity  motion  platforms  is  not  unchallenged. 
Demarec,  Norman,  and  Matheny  (1965)  concluded 
that  in  many  instances  the  level  of  motion  fidelity 
could  be  reduced  without  any  appreciable 
performance  decrement  on  tracking  tasks. 
Huddleston  (1966)  reported  that  motion  may  not 
be  necessary  for  those  tasks  performed  in  the  more 
stable  flight  regimes,  although  it  may  be  beneficial 
m highly  dynamic  regimes  Finally,  the  study 
conducted  by  Jacobs  and  Roscoe  (1975)  high- 
lighted a vital  issue  Roscoe  found  that  pilot 
performance,  in  terms  of  errors  committed, 
improved  in  the  simulator  with  the  presence  of  a 
type  of  motion,  either  normal  washout  in  random 
washout.  Hie  critical  point  was  that  the  random 
washout  condition  provided  essentially  appropri- 
ate onset  cueing,  but  random  directional  cueing. 


Recent  development  in  visual  system  technol- 
ogy have  dramatically  increased  the  amount  and 
quality  of  visual  information  displayed  to  the 
pilot.  One  important  aspect  of  visual  dispalys  that 
has  received  considerable  research  is  the  FOV 
required  to  successfully  perform  certain  tasks  in 
the  simulator.  Roscoe  (1951)  ascertained  that 
pilots  were  able  to  land  safely  with  a very  limited 
FOV  (±  10°  horizontal  and  vertical).  However,  he 
also  concluded  that  increasing  the  FOV  improved 
pilot  performance  on  the  landing  task.  Armstrong 
(1970)  examined  landing  performance  of  military 
pilots  under  a restricted  (±  25°)  horizontal  display, 
vertical  FOV  being  unlimited,  and  discovered  that 
pilot  performance  was  nearly  unchanged  with  this 
loss  in  peripheral  vision  cueing.  Reeder  and 
Kolnick  (1964)  reported  similar  results.  Wolff 
(1971),  using  these  findings,  suggested  that  a 60° 
horizontal  display  was  usually  adequate  for  most 
piloting  tasks  requiring  visual  cueing. 

The  majority  of  research  on  the  interactive 
effects  of  motion  and  visual  cues  deals  with 
visually  induced  motion  (Young,  Dichgans, 
Murphy,  & Brandt,  1973;  Young,  Oman,  Curry,  & 
Dichgans,  1973).  Associated  with  this  phenom- 
enon is  the  problem  of  disorientation  and 
simulator  sickness  thought  to  be  caused  by* 
conflicting  cues;  i.e.,  a moving  visual  display 
accompanied  by  a stationary  cockpit.  Althou$i 
such  psychophysiological  effects  have  been  studied 
rather  extensively,  there  is  a lack  of  information 
relating  to  the  relative  contributions  of  the 
interactions  of  various  visual  displays  and  motion 
configurations  to  pilot  perfonnance. 

It  should  be  noted  that  the  research  findings 
reviewed  are  extremely  subject,  task,  and  vehicle 
specific.  For  example,  the  visual/motion  cues 
required  to  simulate  an  air  combat  engagement  in 
an  F-15  aircraft  undoubtl.  differ  greatly  from 
those  required  for  a straight-in  approach  and 
landing  in  a T-37  aircraft.  Further,  these  studies 
were  concerned  with  pilot  performance  in  the 
simulator,  which  may  or  may  not  be  related  to  the 
training  effectiveness  of  the  simulators. 
Considerations  of  this  type  usually  place  stringent 
limitations  on  the  generalizations  that  may  be 
made  from  a study.  The  present  study  is  no 
exception  to  tins  rule,  and  its  findings  are  subject 
to  the  same  caveats. 


II.  METHOD 

A rather  complex  experiment  was  required  in 
order  to  achieve  the  purposes  of  the  study.  Tins 
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resulted  because  the  firsthand  third  objectives  (i.e., 
ir.vestigatior  of  multifactor  expeimental  space  and 
use  of  a h:^hly  economical  design)  were  difficult 
to  comoine  in  one  package.  The  design  that 
satisfied  these  objectives  became  the  driving 
element  that  determined  the  method*  and 
procedures-. 

Subjects 

Three  experienced  pilots  were  selected  as 
subjects  in  order  to  remove  the  confounding  effect 
of  learning  from  the  performance  scores.  The 
subjects  were  T-37  instructor  pilots  (IP)  at 
Williams  Air  Force  Base,  Arizona,  whose  flying 
time  ranged  from  550  to  900  hours. 

Apparatus 

The  ASPT  located  at  AFHRL/FT  was  used  for 
the  duration  of  the  study. 

The  following  description  of  ASPT  briefly 
delineates  those  capabilities  of  ASPT  used  in  this 
experiment.  In-depth  technical  references  are 
found  in  Bell  (1974);  Hagin  and  Smith  (1974);  and 
Rust  (1975). 

ASPT  has  two  fully  instrumented  T-37  cockpits 
mounted  upon  six  DOF  motion  platforms.  The 
synergistic  motion  system  has  six  active  drive  legs 
with  approximately  three  feet  of  vertical  travel 
and  four  feet  of  horizontal  travel.  Displacement 
capabilities  include:  pitch  -20  degrees  to  +30 
degrees;  roll  ±22  degrees;  and  yaw  ±32  degrees. 
These  displacements  are  intended  to  provide  initial 
(on-set)  cues  for  all  maneuvers.  The  31 -bellow 
pneumatic  G-seat  in  ASPT  is  designed  to  provide 
more  continuous  cues  than  the  motion  platform 
and  accomplishes  this  by  the  orderly  inflation  and 
deflation  of  the  bellows  in  response  to  the  require- 
ments of  each  particular  maneuver. 

The  visual  system  of  ASPT  is  comprised  of 
seven  36-inch  monochromatic  cathode  ray  tubes 
(CRT)  placed  around  the  cockpit  giving  the  pilot 
+110  degrees  to  —40-degrees  vertical  cueing  and 
±150  degrees  of  horizontal  cueing.  The  computer 
generated  visual  scene  has  the  capability  to  display 
information  for  most  pertinent  ground  references 
(mountains,  runways,  hangars,  °tc.)  within  a 100 
square  nautical  mile  area  of  Williams  AFB.  As  the 
T-37  moves  through  this  environment,  the  visual 
imagery  is  updated  30  times  per  second  such  that 
the  presentations  are  similar  to  what  a pilot  would 
see  in  the  real  world. 


Automated  performance  measures  are  collected 
and  stored  at  an  iteration  rate  of  3.75  to  15  times 
per  second 

The  computer  system  also  possesses  a 
Cognitronics  voice  capability  for  ground- 
controlled  approaches  (GCA).  All  systems  of 
ASPT  (motion,  visual,  etc.)  can  be  degraded  to 
match  a wide  variety  of  environmental  conditions 
or  aerodynamic  characteristics. 

Design 

One  of  the  principal  considerations  of  any 
projected  research  is  that  of  economy  ' resources. 
There  are  practical  limitations  to  the  . imber  of 
individuals  chosen  to  participate,  the  number  of 
observations  selected,  the  amount  of  time  available 
to  gather  the  information,  and  most  critically,  the 
expenses  incurred.  Generally,  two  approaches  have 
been  used  to  circumvent  this  problem:  methodi- 
cally developing  a research  strategy;  or  statistically 
controlling  the  experimental  design.  Under  the 
second  approach,  countless  methods  have  been 
developed  to  achieve  economy  in  the  collection 
and  analysis  of  information  ranging  from  the 
traditional  one-way  analysis  of  variance  to  the 
fairly  recent  response  surface  designs.  Simon 
(1973)  has  written  extensively  on  the  use  of 
screening  studies  for  achieving  a maximum  amount 
of  information  with  a minimum  expenditure  of 
effort  in  terms  of  time,  sample  size,  and  equip- 
ment usage.  Simon  proposed  the  use  of  multilevel, 
multivariable  designs  where  oy  analysis  provides  an 
economical  “map”  of  the  significant  experimental 
space.  This  “map”  is  then  used  to  guide  more 
thorough  research  in  the  area.  The  design  used  in 
this  stiidy  followed  the  “mapping”  approach. 

Two  separate  experimental  designs  were 
utilized.  The  first  design,  structured  to  evaluate 
main,  first-order  interaction  and  second-order 
interaction  effects  of  all  six  independent  variables 
was  configured  as  a 33  23  randomized  block 
partially  confounded  factorial. 

Tire  six  independent  vanables,  three  with  two 
levels  each  (ceihng/visibihty,  field  of  view, 
G-seat)  and  three  with  three  levels  each  (winds, 
turbulence,  motion),  generated  216  unique 
treatment  combinations.  Using  randomization, 
each  of  the  three  subjects  was  assigned  a block  of 
72  treatment  combinations  under  which  they  flew 
takeoffs,  GCAs,  and  360  degree  overhead  patterns 
Facn  of  the  three  pilots  flew  one-tlurd  ot  all  pos- 
sible treatment  combinations,  reducing  total  cell 
numbers  from  216  to  72  jier  subject 


The  second  design,  a 34  randomized  block 
partially  confounded  factorial,  used  four  indepen- 
dent variables  (turbulence,  motion,  field  of  view, 
G-seat)  each  with  three  levels  which  generated  81 
unique  treatment  combinations.  Field  of  view 
(FOV)  and  G-seat  were  modified  from  their  two- 
level  configuration  in  the  33  23  design  to  three- 
level  variables  in  the  34  desip.  Each  of  the  three 
subjects  flew  aileron  rolls  and  slow  flights  under 
27  of  the  81  conditions. 

In  both  desips,  the  confounding  occurred  in 
the  third  order  and  higher  order  interactions. 
These  interactions  were  hypothesized  to  contri- 
bute little  to  the  experimental  variance  and  were 
thus  deemed  to  be  of  slight  interest.  To  increase 
statistical  power,  these  confounded  interactions 
were  added  into  the  error  terms. 

Independent  Variables 

Six  independent  variables  (IV)  were  employed 
in  the  first  desip.  These  were  selected  so  that  the 
subjects  performed  the  desipated  maneuvers 
across  a wide  variety  of  environmental  conditions 
and  simulator  confiprations. 

Three  IVs  (wind,  turbulence,  and  eiling / 
visibility)  dealt  with  environmental  conditions. 
Three  levels  of  the  wind  variable  were  selected: 
zero,  12,  or  24  knots  all  generated  from  60  degrees 
left  of  the  runway  centerline.  The  turbulence 
variable  was  composed  of  no  turbulence,  light,  or 
moderate  tuibulence  conditions.  The  ceiling/ 
visibility  (C/V)  variable  had  two  levels:  clear  and 
minimums.  The  minimums  were  defined  as  200 
feet  ceiling  and  XA  mile  visibility  (200  feet/14  mile) 
for  the  GCA  maneuver  and  1200  feet/3  miles  for 
the  360  degree  overhead  pattern  maneuver,  and 
represented  real-world  minimum  allowable  condi- 
tions for  those  maneuvers.  These  three  IVs  yielded 
18  unique  environmental  conditions  ranging  from 
no  wind,  no  turbulence,  and  clear  C/V  to  24  knots 
crosswind,  moderate  turbulence,  and  clear  C/V  to 
24  knots  crosswind,  moderate  turbulence  and 
minimum  C/V. 

Three  IVs  dealt  with  the  confipration  of 
ASPT.  Zero,  three  and  six  DOF  levels  were 
selected  for  the  motion  variable.  The  three  DOF 
condition  included  motion  only  in  pitch,  roll,  and 
heave  (vertical  translation)  dimensions.  The  six 
DOF  condition  consisted  of  motion  in  pitch,  roll, 
yaw,  longitudinal,  vertical,  and  lateral  displace- 
ment. The  FOV  variable  had  two  conditions: 
masked  and  full.  The  full  condition  utilized  all 


seven  cathode  ray  tube  (CRT)  channels.  The 
masked  FOV,  desiped  to  represent  the  FOV  of 
many  small  visual  displays  currently  in  use,  had  a 
36-degree  vertical  and  48-degree  horizontal  FOV. 
The  36  degree  by  48  degree  masked  FOV  was 
created  by  shutting  down  five  of  the  seven  CRTs 
and  placing  a portable  black  cardboard  mask  over 
portions  of  the  two  remaining  CRTs  to  reduce  the 
FOV  to  36  degrees  by  48  degrees.  The  G-seat 
variable  possessed  two  levels:  functional  or  non- 
functional. 

The  combination  of  environmental  and  ASPT 
confipration  IVs  (18x12)  produced  216  unique 
treatment  cells. 

The  second  desip  used  four  IVs,  each  having 
three  levels  (34).  Two  of  the  four  variables  used  in 
this"  design,  motion  and  turbulence,  were 
confipred  exactly  as  above.  The  third  variable, 
FOV,  had  masked  and  full  FOVs  as  in  the  first 
desip,  but  added  a third  level  in  which  there  was 
no  visual  scene  present  in  order  to  simulate  a 
completely  instrument  flight  rules  (IFR)  condi- 
tion. The  fourth  variable,  G-seat,  similarly  was 
either  functional  or  non-functional  as  in  the  first 
desip,  but  added  a third  level  which  directed  that 
only  the  G-seat’s  pan  was  functional.  The  Seat  Pan 
Only  confipration  made  use  of  only  those 
pneumatic  panels  located  in  the  area  of  the  pilot’s 
buttocks  in  order  to  estimate  the  separate  contri- 
butions of  these  panels. 

These  combinations  of  environmental  and 
ASPT  configuration  IVs  produced  81  unique  treat- 
ment cells. 

Flight  Tasl's 

In  this  stidy,  the  term  “flight  tasks”  refers  to 
the  five  specific  maneuvers  flown  by  the  subjects. 
These  maneuvers  were  selected  to'  encompass  a 
broad  spectrum  of  representative  subtasks  in  the 
undergraduate  pilot  training  (UPT)  curriculum 
(Meyer,  Laveson,  Weissman,  & Eddowes,  1974). 

In  the  first  desip,  each  subject  flew  72  take- 
offs, 72  GCAs,  and  72  360-degree  overhead 
patterns  for  a total  of  216  maneuvers  (under  the 
varying  environmental/system  confiprations)  per 
subject.  In  the  second  portion  of  the  experiment, 
each  subject  flew  27  aileron  rolls  and  27  slow 
flights  for  a total  of  54  maneuvers  (under  the 
various  confiprations)  per  subject. 

Dependent  Variables 

The  dependent  vanables  used  in  this  study  were 
derived  from  the  ASPT  Automated  Performance 
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Measurement  System  (APMS).  The  APMS  is 
basically  a criterion-referenced  approach  to 
measurement.  Because  most  skillful  piloting 
involves  the  attempt  to  maintain  or  change  to 
specified  flight  parameter  criteria  (e.g.,  airspeed, 
altitude,  vertical  velocity),  deviations  from  these 
desired  parameters  provides  a method  of  quantita- 
tive objective  performance  measurement. 

For  this  study,  sets  of  dependent  variables 
believed  to  be  of  relevance  were  selected  indepen- 
dently for  each  maneuver  and  were  recorded  via 
the  APMS  at  an  iteration  rate  between  3.75  and  1 5 
times  per  second.  The  variables  monitored  are 
listed  in  Appendix  A.  These  dependent  variables 
were  classified  into  three  categories:  (a)  system 
output  measures,  (b)  pilot  input  measures,  and  (c) 
derived  measures. 

System  output  measures  were  used  to  measure 
deviations  from  desired  criteria  via  root  mean 
square  techniques  (Waag,  Eddowes,  & Fuller, 
1974),  which  have  been  demonstrated  to  be 
reliable  descriminators  of  pilot  performance. 

Pilot  input  measures  were  computed  to  deter- 
mine an  analog  to  how  much  effort  or  work  was 
expended  by  the  pilot  on  the  aircraft  controls 
during  the  maneuver.  It  has  been  generally 
accepted  that  pilots  with  more  experience  make 
fewer,  more  precise  correctional  movements  than 
relatively  inexperienced  pilots.  This  analog  was 
measured  for  aileron,  elevator,  and  rudder  control. 
This  analog  of  pilot  effort  was  computed  as  work 
per  unit  of  time  and  was  expressed  by  the 
following  equation: 

Pilot  Input  = r/n  2 |Pj  - Pj_  1 1 X |fj  + f._  j 1 


where  r is  the  sampling  rate,  n is  total  number  of 
^UPgles,  P is^conriol_  position,  and  f is  control 
iorce. 

The  derived  measures  were  a set  of  measures 
that  produce  a single  composite  score  for  a 
particular  segment  of  a maneuver  or  a complete 
maneuver.  For  the  most  part,  this  score  was  based 
on  the  pilot’s  proficiency  in  simultaneously 
staying  within  several  tolerance  bands  constructed 
around  the  desired  criteria.  The  score  was  a 
percent-time-within-tolerance  measure.  Tolerance 
bands  were  constructed  using  the  performance  of 
experienced  pilots  for  each  maneuver  or  maneuver 
segment  as  a basis. 


This  approach  to  performance  measurement 
was  implemented  through  use  of  the  ASPT  Pre- 
programming System.  This  system  permitted 
generation  of  FORTRAN  programs,  called  exercise 
segments,  which  used  simulator  flight  variables  as 
input  data.  (For  a complete  description  of  the  five 
exercise  segments,  see  Appendix  A). 

Table  1 lists  all  dependent  variables  by 
maneuver.  Because  system  measures  used  deviation 
scores,  a smaller  score  indicated  better  perform- 
ance. Similarly,  on  pilot  input  scores,  smaller 
forces  applied  by  the  pilot  to  remain  within  the 
established  tolerances  produced  smaller  scores, 
indicative  of  better  performance.  The  derived 
measures,  however,  were  based  on  percent-time- 
within-tolerance  scale  with  100%  being  defined  as 
remaining  within  the  given  tolerance  bands  for  the 
entire  duration  of  observation.  Thus,  higher 
percentages  indicate  better  scores. 

Procedures 

The  procedures  used  in  the  study  can  conveni- 
ently be  separated  into  two  classes:  subject 
pretraining,  and  data  collection  procedures. 

1.  Subject  pretraining.  Each  subject  was  given 
approximately  3.5  hours  in  ASPT  for  the  purpose 
of  familiarization  and  warmup  one  to  two  days 
before  the  start  of  the  study.  During  this  time,  two 
separate  mission  profiles  with  varying  environ- 
mental conditions  were  briefed  to  and  practiced 
by  the  subjects. 

PROFILE  1 (33  23  Design  Maneuvers) 

a.  Takeoff  and  climb  on  course  (begun  at 
takeoff  clearance). 

b.  GCA  (begun  at  five  miles  from  touch- 
down gate). 

c.  VFR  “overhead”  traffic  pattern  (begun 
on  initial). 

PROFILE  II  (34  Design  Maneuvers) 

a.  Slow  flight  (initialized  at  100  kts,  12  K 
ft). 

b.  Aileron  roll  (initialized  at  160  kts,  15K 
ft). 

2.  Data  Collection  Procedures.  In  the  course 
of  the  study,  each  subject  flew  Profile  1 72  times 
and  Profile  II  27  times  as  required  by  tire  experi- 
mental design.  On  the  average,  Profile  I required 
19  minutes  for  completion  and  Profile  II  required 
6 minutes.  The  two  profiles  were  randomly 
ordered  for  all  subjects.  The  mission  profiles  were 
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Table  1.  Dependent  Variable  Listing 


Dependent  Variable  Nama  Typa 

Units 

« 

1. 

Heading  Deviation 

Takeoff  and  Climb  on  Course 

System 

Degrees 

2. 

Pitch  Deviation 

System 

Degrees 

3. 

Course  Deviation 

System 

Degrees 

4. 

Airspeed  Deviation 

System 

Knots 

5. 

Elevator  Power 

Pilot 

lbs-deg/sec 

6. 

Aileron  Power 

Pilot. 

lbs-deg/sec 

7. 

Rudder  Power 

Pilot 

lbs-deg/sec 

1. 

Total  Score 

GCA  and  Landing 

Derived 

Percent 

2. 

Touchdown  Score 

Derived 

Percent 

3. 

Altitude  Deviation 

System 

Feet 

4. 

Airspeed  Deviation 

System 

Knots 

5. 

Centerline  Deviation 

System 

Feet 

6. 

Glidepath  Deviation 

System 

Feet 

7. 

Elevatoi  Power 

Pilot 

lbs-deg/sec 

8. 

Aileron  Power 

Pilot 

lbs-deg/sec 

9. 

Rudder  Power 

Pilot 

lbs-deg/sec 

10. 

Elevator  Power 

Pilot 

lbs-deg/sec 

11. 

Aileron  Power 

Pilot 

lbs-deg/sec 

12. 

Rudder  Power 

Pilot 

lbs-deg/sec 

1. 

Pitchout  Altitude 

360°  Overhead  Pattern  and  Landing 

System 

Feet 

2. 

Pitchout  Bank 

System 

Degrees 

Elevator  Power 

Pilots 

lbs-deg/sec 

4. 

Atleron  Power 

Pilot 

lbs-deg/sec 

5. 

Rudder  Power 

Pilot 

lbs-deg/sec 
Feet  * 

6. 

Downwind  Altitude  Deviation 

System 

7 

Downwind  Score 

Derived 

Percent 

8. 

Elevator  Power 

Pilot 

lbs-deg/sec 

9. 

Aileron  Power 

Pilot 

lbs-deg/sec 

10. 

Rudder  Power 

Pilot 

lbs-deg/sec 

11. 

Final  Turn  Bank  Deviation 

System 

Degrees 

12. 

Final  Turn  Airspeed  Deviation 

System 

Knots 

13. 

Elevator  Power 

Pilot 

lbs-deg/sec 

14. 

Aileron  Power 

Pilot 

lbs-deg/sec 

15 

Rudder  Power 

Pilot 

lbi-deg/sec 

16. 

Glidepath  Deviation 

System 

Feet 

17. 

Centerline  Deviation 

System 

Feet 

18. 

Final  Airspeed  Deviation 

System 

Knots 

19. 

Final  Score 

Derived 

Percent 

20. 

Elevator  Power 

Pilot 

lbs-deg/sec 

21. 

Aileron  Power 

Pitot 

lbs-deg/sec 

22. 

Rudder  Power 

Pilot 

lbs-deg/sec 

23. 

Landing  Score 

Derived 

Percent 

1 

Altitude  Deviation 

Slow  Flight 

System 

Feet 

2. 

Airspeed  Deviation 

System 

Knots 

3. 

Slip  Indicator  Deviation 

System 

Degrees 

4. 

Total  Score 

Derived 

Percent. 

5. 

Elevator  Power 

Pilot 

lbs-deg/sec 

6. 

Aileron  Power- 

Pilot 

lbs-deg/sec 

7. 

Rudder  Power 

Pilot 

lbs-deg/sec 

1 

Bank  in  Deviation 

Aileron  RoD 

System 

Degrees 

2 

Roll  Acceleration 

System 

Degrees/Sec’ 

3. 

Roll  Score 

Derived 

Percent 

4. 

Bank  Out  Deviation 

System 

Degrees 

5 

Aile'on  Power  (In) 

Pilot 

lbs-deg/sec 

6. 

Aileron  Power  (Roll) 

Pilot 

lbs-deg/sec 

7. 

Aileron  Polver  (Out) 

Pilot 

lbs-deg/sec 

8. 

Total  Score 

Derived 

Percent 

flown  consecutively  within  a data  collection 
period,  which  varied  from  one  to  two  hours  in 
length  dependent  upon  ASPT  system  availability. 
Rest  periods  were  provided  whenever  requested  by 
the  subject  IPs. 

After  the  pilot  strapped  into  the  cockpit,  each 
session  was  begun  with  instructions  provided  by 
the  Cognitronics  computer-driven  word  generator. 
During  strap-in,  the  console  operator  entered 
identification  information  into  the  APMS  files, 
modified  the  simulator  configuration,  and  set  the 
environmental  factors.  Each  maneuver  was  begun 
on  command  and  completed  when  selected  criteria 
were  satisfied;  i.e.,  the  takeoff  and  climb  on  course 
was  terminated  when  the  altitude  equalled  3,000 
feet  mean  sea  level  (MSL).  An  aural  tone  signified 
termination  of  the  maneuver.  In  the  case  of  the 
GCA,  the  Cognitronics  generator  provided  all 
verbal  information  to  the  subject,  including  glide- 
slope  and  centerline  deviations.  At  the  completion 
of  each  maneuver  within  the  profile,  the  console 
operator  entered  comments  on  any  system  mal- 
functions, operator  or  subject  error  experienced 
during  the  maneuver. 

All  profiles  were  fiown  in  cockpit  A of  the 
ASPT  to  control  for  possible  inter-cockpit 
differences. 

In  setting  up  those  treatment  conditions  which 
required  the  motion  system  to  be  inoperative,  the 
console  operator  initially  raised  the  platform  and 
then  froze  it  in  an  attempt  to  preclude  subject 
awareness  of  the  simulator  configuration.  During 
the  course  of  the  study,  however,  the  subjects 
became  “experiment  wise”  and  were  often  able  to 
discern  the  exact  configuration. 

Prior  to  the  execution  of  each  maneuver,  all 
environmental  conditions,  (i.e.,  ceiling/visibility, 
winds,  turbulence)  were  given  to  the  pilots  as  they 
would  be  in  the  real-world  of  flying. 

Due  to  a hardware  configuration  error  in  the 
method  of  setting  the  particular  G-seat  configura- 
tion, each  IP  had  to  refly  1 8 profiles,  resulting  in  a 
total  of  1 17  profiles  flown  per  subject. 

The  major  constraint  in  subject  scheduling  was 
ASPT  system  availability.  Subjects  were  scheduled 
on  a day-to-day  basis.  Data  collection  began  on  25 
June  75  and  was  terminated  on  30  October  75. 
System  reliability  during  the  conduct  of  the  study 
was  approximately  62  percent,  as  measured  by  the 
following  ratio:  hours  of  successful  data 
collection/hours  scheduled  for  the  effort. 


Analysis 

The  analysis  presented  in  this  technical  report 
differs  significantly  from  that  given  in  a previous 
one  (Waters,  Grunzke,  Irish,  & Fuller,  1976).  The 
earlier  report  was  based  on  a univariate  analysis  of 
each  dependent  variable.  The  present  report 
utilized  a multivariate  approach. 

In  recognition  of  the  intercorrelations  between 
the  dependent  variables  of  each  specific  maneuver 
measurement  set  (Waters  et  al.,  1976),  a multi- 
variate analysis  of  variance  (MANOVA)  was 
selected  as  the  appropriate  omnibus  test  (Harris, 
1975).  A MANOVA  was  performed  for  each 
maneuver  which  resulted  in  five  overall  tests  of 
significance.  The  statistic  used  in  determining 
significance  of  effects  was  the  Wilks  Lambda  (X). 
The  Wilks  Lambda  statistic,  while  not  only  being 
less  difficult  to  compute  than  the  greatest  charac- 
teristic root  (GCR)  method,  also  provided  a more 
powerful  test  than  the  latter  (with  the  assumption 
of  nearly  equivalent  characteristic  roots).  Upon 
reaching  significance,  traditional  step-down  uni- 
variate Fs  were  computed  for  each  dependent 
variable.  Means  and  exact  probability  levels 
p(F>F0)  were  also  computed  for  each  dependent 
measure.  The  alpha  level  for  this  study  was  set  at 
.05. 

Additional  multivariate  post  hoc  tests  were  not 
pursued  for  two  reasons.  First,  the  Wilks  Lambda 
does  not  lend  itself  to  further  multivariate 
contrasts;  and  second,  the  sample  size  employed 
was  not  sufficient  for  extensive  multivariate  com- 
parison using  a multiple  discriminant  or  principal 
components  analysis. 

Although  the  step-down  Fs  are  subject  to 
similar  Inflation  of  the  Type  1 error  rate  as  are  a 
series  of  conventional  univariate  ANOVAs  (Harris, 
1975),  a screening  study  of  this  type  would  prefer 
minor  inflation  in  Type  1 rather  than  Type  II  error 
rates  in  order  that  all  possible  sources  of  variance 
may  be  identified  for  future  studies.  Additionally, 
percent  of  non-error  variances  (%  NEV)  were 
computed  for  each  source  of  variance  so  that  the 
relative  importance  of  each  effect  could  be 
estimated. 

The  matrices  used  to  construct  the  MANOVA 
tables  were  structured  such  that  all  main  effects, 
first  order  interaction  effects  and  second  order 
interaction  effects  were  orthogonal  to  one  another 
in  the  33  23  design  with  the  exception  of  the  Wind 
by  Turbulence  by  Motion  interaction  which  had 
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two  of  its  degrees  of  freedom  confounded  with 
between  block  variation.  All  third  order  and  higher 
interactions  were  assumed  to  be  negligible.  The  34 
design  was  structured  so  that  all  main  effects  and 
first  order  interactions  were  orthogonal,  with 
second  order  and  higher  order  interactions 
assumed  to  be  zero. 

The  final  statistical  procedure  performed  upon 
the  data  consisted  of  rank  ordering  the 
performance  of  each  dependent  measure  for  those 
interactions  of  statistical  significance.  Because  the 
dependent  variables  varied  greatly  in  the  nature  of 
their  units  and  the  direction  of  best  performance 
in  terms  of  their  absolute  values,  a procedure  was 
required  which  accounted  for  these  differences. 
The  selected  method  included  the  rank  ordering  of 
performance  on  the  dependent  measures  from  best 
to  worst  performance  within  every  treatment  cell 
of  the  interaction.  The  ranks  were  then  summed 
across  all  dependent  measures  for  each  cell  and  an 
average  rank  was  determined.  Nemenyis’  test 
(Kirk,  1968)  was  employed  to  determine  the 
location  of  significant  differences  between  the 
average  ratings  in  the  treatment  cells.  This  method 
allowed  the  dependent  measures  to  be  summed 
into  an  unweighted  linear  combination,  thus 
providing  insight  into  the  relative  strength  and 
direction  of  the  performance  measurement  sets 
within  each  interaction.  Since  it  was  impossible  to 
empirically  determine  what  the  individual  variable 
weights  should  have  been,  this  procedure  used 
equivalent  weights  for  all  variables.  Although  this 
method  varied  somewhat  from  a more  traditional 
approach,  it  offered  a straight-forward  and 
relatively  economical  method  of  describing  the 
underlying  processes  at  work  within  each 
interaction. 


III.  RESULTS 

Because  of  the  sizeable  quantity  of  information 
this  study  produced,  the  results  section  is 
structured  in  the  following  manner.  Initially 
reported  are  the  main  effects  which  reached 
significance.  These  effects  are  classified  into  two 
categories:  environmental  variables,  and  system 
configuration  variables.  Presentation  of  the 
significant  first  order  interactions  follows;  these 


’The  disparity  between  the  multivariate  and  univariate 
source  tables  for  the  main  and  interaction  effects  stems 
from  the  method  in  which  the  DOT  have  been  pattitioned 
m the  two  analyses,  both  analyses  arc  correct,  however, 
the  univariate  tests  gwe  a more  conservative,  more 
po  verful  test  of  significance. 


were  subdivided  into  three  major  classes.  These 
classes  are:  interactions  of  environmental  variables 
with  environmental  variables,  interactions  of 
system  variables  with  environmental  variables,  and 
system  variable  by  system  variable  interactions. 
Finally,  the  one  second-order  (three  variable) 
interaction  which  reached  significance  was 
reported.  This  scheme  was  followed  in  reporting 
the  results  of  the  33  23  design,  and  then  repeated 
for  the  34  design.1 

33  23  Environmental  Variables 

Wind.  The  first  environmental  main  effect 
considered  was  the  wind  factor.  The  wind  main 
‘effect,  as  expected,  evidenced  consistent  linear 
effects.  As  wind  velocity  increased,  flying  perform- 
ance decreased.  Table  2 depicts  the  means, 
univariate  Fs  and  the  Wilks  Lambda  for  the  wind 
matrix  for  the  takeoff,  GCA,  and  overhead  pattern 
maneuvers. 

The  wind  effect  was  significant  in  the  omnibus 
multivariate  test  across  each  of  the  three 
maneuvers  measures  (p<.001).  The  direction  of 
significance  as  indicated  by  the  tabled  means 
shows  that  under  increasingly  windy  conditions, 
deviations  from  the  desired  course  were  greater 
and  that  more  subject  effort  was  needed  to  fly  the 
simulator. 

For  the  univariate  analyses,  of  the  seven  vari- 
ables in  the  matrix  for  the  takeoff  maneuver,  three 
(heading  deviation,  aileron  power  and  rudder 
power)  were  significant  at  the  univariate  level 
(p<001)  and  had  relatively  consistent  effects; i.e., 
increased  wind  intensity  produced  more  course 
deviation  and  effort. 

The  GCA  landing  task  showed  five  dependent 
variables  with  significant  univariate  F ratios 
(p  < .001).  Four  of  these  measures  (rudder  power 
(final),  aileron  power,  elevator  power,  rudder 
power  (landing))  were  pilot  input  measures  and 
one  derived  measure  (touchdown  score) 
demonstrated  linear  effects.  Of  the  remaining 
three  variables  (rudder  power  (2),  and  aileron 
power)  curvilinear  effects  were  manifested.  The 
last  measure,  elevator  power  (landing  phase) 
showed  best  performance,  assuming  that  fewer  and 
smaller  corrections  indicated  better  Hying,  under 
the  maximum  wind  condition  followed  by  no 
wind  and  lastly  12  knots  of  wind.  This  was  likely  a 
maneuver-specific  artifact  due  to  its  inconsistency 
with  all  of  the  other  measures. 

In  tire  overhead  pattern  maneuver,  12  of  23 
dependent  variables  were  significant  at  p<05  in 
the  univariate  analysis.  These  12  dependent  vari- 
ables included  four  system  output  dependent 
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Table  2.  Wind  Main  Effects  Across  Takeoff,  GCA,  and  Overhead  Pattern  Maneuvers 


u 

I 

I 

r 

i 


i 


£ 


i"' 


I 


Sourc* 

X(0  Knott) 

X(1 2 Knott) 

X(24  Knott)  SSBET 

SSW/IN 

F 

P 

Takeoff 

Heading  Deviation 

2.10 

2.66 

5.39 

448 

225 

2.11 

.000* 

Pitch  Deviation 

1.71 

1.89 

1.89 

1.57 

115 

1.45 

.236 

Course  Deviation 

.926 

1.10 

1.30 

5.05 

216 

2.49 

.086 

Airspeed  Deviation 

5.55 

4.66 

5.01 

29.0 

3550 

.871 

.420 

Elevator  Power 

2.45 

2.54 

2.67 

1.63 

113 

1.53 

.219 

Aileron  Power 

.606 

.766 

.977 

5.00 

53.5 

9.94 

.000* 

Rudder  Power 

.279 

.468 

.519 

2.42 

23.3 

11.07 

.000* 

Wilks  Lambda 

df, 

df2 

P(F>F0) 

.278 

14 

414 

.000* 

GCA 

Total  Score 

25.7 

23.5 

25.1 

182 

26100 

.744 

.476 

Touchdown  Score 

87.3 

84.2 

79.2 

2400 

28700 

8.89 

.000* 

Altitude  Deviation 

40.9 

39.8 

38.1 

289 

91700 

.335 

.715 

Airspeed  Deviation 

2.44 

2.47 

2.86 

8.10 

350 

2.46 

.087 

Centerline  Deviation 

96.0 

103 

106 

3900 

28200 

1.47 

.232 

Glidepath  Deviation 

38.4 

35.9 

33.6 

837 

42600 

2.09 

.126 

Elevator  Power 

.436 

.463 

.447 

.027 

123 

.231 

.794 

Aileron  Power 

.419 

.516 

.457 

350 

.300 

1.24 

.291 

Rudder  Power 

.067 

.098 

.168 

397 

4.76 

8.87 

.000* 

Elevator  Power 

4.28 

4.91 

3.40 

83.1 

1300 

6.82 

.001* 

Aileron  Power 

1.04 

2.03 

1.96 

44.0 

363 

12.9 

.000* 

Rudder  Power 

1.72 

5.89 

17.0 

8960 

9i20 

104 

.000* 

Wilks  Lambda 

df, 

dfj 

P(F>F0) 

.349 

24 

404 

.000* 

Overhead  Pattern 

Pitchout  Altitude  Deviation 

40.8 

41.7 

42.8 

145 

172,000 

.090 

.914 

Pitchout  Bank  Deviation 

6.25 

10.9 

14.9 

2680 

4,090 

69.9 

.000* 

Elevator  Power 

2.46 

1.81 

1.40 

41.4 

324 

13.6 

.000* 

Aileron  Power 

.688 

.537 

.393 

3.13 

39.7 

8.41 

.000* 

Rudder  Power 

.049 

.078 

.089 

.064 

9.74 

.698 

.499 

Downwind  Alt  Dev 

42.3 

36.2 

42.0 

1710 

122,000 

1.49 

.227 

Downwind  Score 

66.8 

71.2 

62.0 

3060 

134,000 

2.43 

.090 

Elevator  Power 

2.24 

2.10 

1.91 

3.86 

301 

1.36 

.258 

Aileron  Power 

1.31 

1.23 

1.11 

1.51 

220 

.732 

.482 

Rudder  Power 

.106 

.101 

.093 

.006 

7.06 

.094 

.910 

Final  Turn  Bank  Dev 

9.55 

10.9 

11.2 

109 

5130 

2.25 

.107 

Final  Turn  Airspeed  Deviation 

4.42 

4.58 

8.51 

772 

2370 

34.6 

.000* 

Elevation  Power 

1.22 

1.59 

2.08 

26.7 

251 

113 

.000* 

Aileron  Power 

.739 

.751 

.932 

1.67 

51.9 

3.43 

.034* 

Rudder  Power 

.287 

378 

.600 

3.73 

116 

3.43 

.034* 

Glidepath  Deviation 

.875 

1.28 

1.30 

8.25 

285 

3.08 

.047* 

Centerline  Deviation 

92.4 

159 

155 

170,000  1350,000  133 

.264 

Final  Airspeed  Deviation 

3.79 

3.92 

6.69 

388 

3020 

13.7 

.000* 

Final  Score 

12.2 

15.1 

3.50 

5270 

73,600 

7.63 

.000* 

Elevator  Power 

2.71 

3.07 

3.29 

12.5 

548 

2.42 

.091 

Aileron  Power 

1.29 

1.81 

2.76 

80.8 

276 

31.2 

.000* 

Rudder  Power 

1.16 

4.07 

6.74 

1120 

2060 

58.2 

.000* 

Landing  Score 

77.4 

76.2 

75.9 

85.9 

23,700 

.385 

.680 

Wilks  Lambda 

df, 

df2 

p(F>Fc 

,) 

.224 

46 

382 

.000* 

Not*.  — All  univariate  F-ratios  evaluated  at  F,,  , , 
* p < .05. 
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variables,  seven  pilot  input  dependent  variables, 
and  one  derived  dependent  measure.  Of  these 
variables  which  exceeded  the  significance  criterion, 
three  ’(elevator  power  (pitchout),  aileron  power 
(pitchout),  and  final  score)  indicated  better 
performance  under  increased  wind  conditions.  The 
final  score  measure  demonstrated  slightly 
curvilinear  effects  by  showing  best  performance  in 
the  12  knot  condition,  slightly  deteriorated 
performance  with  no  wind  followed  by  a marked 
decrease  in  performance  in  the  24  knot  condition. 
The  remaining  nine  dependent  variables  indicated 
decreased  performance  as  a function  of  increased 
wind  conditions. 

Turbulence . The  analyses  of  the  second 
environment  variable,  turbulence,  are  presented 
in  Table  3. 

The  turbulence  variable  demonstrated  an 
overall  multivariate  effect  only  on  the  GCA 
landing  maneuver  (p<.001). 

In  the  univariate  analysis,  the  takeoff  maneuver 
produced  one  dependent  variable  (elevator  power) 
that  reached  significance.  This  measure  manifested 
a clear  linear  effect;  i.e.,  best  performance  was 
recorded  under  no  turbulence  followed  in 
sequence  by  light  and  moderate  turbulence. 
Rudder  power  was  the  only  dependent  measure 
to  achieve  significance  in  the  overhead  pattern 
univariate  analysis. 

Ceiling/Visibility.  The  analyses  of  the  final 
environmental  variable,  ceiling/visibility,  are  listed 
in  Table  4 for  the  takeoff,  GCA,  and  overhead 
pattern  maneuvers. 

As  Table  4 shows,  all  three  maneuvers  had 
significant  multivariate  ceiling/visioility  main 
effects  (p<03). 

Under  the  univariate  analysis,  all  dependent 
variables  for  the  takeoff,  excluding  rudder  power, 
had  means  in  tire  expected  direction  (i.e.,  with 
restricted  visibility  conditions  (minimums) 
performance  deteriorated).  Tire  effects  of  reduced 
ceiling/visibility  were ' particularly  apparent  on 
variables  related  to  heading,  airspeed,  and  amount 
of  elevator  power  used  (p<.05). 

The  GCA  maneuver  analysis  has  similar  but  not 
quire  as  powerful  results.  Of  the  12  variables 
measured,  six  variables  (two  significant)  suggested 
improved  performance  in  the  clear  conditions 
while  three  variables  demonstrated  virtually  no 
change  under  cither  condition.  The  remaining 
three  variables  suggested  superior  performance  in 
tlie  minimums  condition.  Nevertheless,  the  overall 
multivariate  test,  as  previously  mentioned, 


indicated  improved  subject  performance  in  the 
same  direction  as  the  majority  of  the  individual 
dependent  variables. 

Ten  of  the  twenty-three  measures  used  in  the 
analysis  of  the  overhead  pattern,  reached 
significance  in  the  ceiling/visibility  univariate 
contrasts.  All  ten  measures  demonstrated  superior 
performance  was  evidenced  under  'the*  clear  C/V 
condition.  These  measures  cover  the  full  range  of 
system  output,  pilot  input  and  derived  scores. 

33  23  System  Variables 

The  system  variables  consisted  of  platform 
motion,  field  of  view,  and  G-seat. 

Motion.  The  results  of  the  analyses  of  the  first 
variable  of  interest,  platform  motion,  are  displayed 
in  Table  5. 

Significance  was  reached  on  the  multivariate 
test  for  all  three  maneuvers  (p<.001). 

In  the  takeoff  maneuver,  the  univariate  analysis 
of  four  of  the  seven  dependent  measures  (three  of 
which  were  system  output  measures)  indicated 
superior  performance  in  the  absence  of  motion; 
however,  review  of  the  three  DOF  and  six  DOP 
motion  conditions  gave  highly  inconsistent  results, 
thereby  negating  the  establishment  of  a perform- 
ance hierarchy. 

The  GCA  maneuver  showed  a more  consistent 
pattern  of  results.  Of  the  12  dependent  variables 
measured  in  the  GCA, 'eight  measures  (five 
significant)  demonstrated  superior  performance  in 
the  absence  of  motion.  The  remaining  dependent 
measures  indicated  superior  performance  under 
the  three  DOF  when  compared  to  the  six  DOF 
morion  condition. 

Similarly,  the  overhead  pattern  evidenced 
performance  trends  consisting  of  improved 
performance  without  motion  followed  by  inferior 
performance  with  three  DOF  and  six  DOF  motion. 

Field  of  View.  The  analysis  of  the,  FOV  main 
effect  is  listed  in  Table  6 for  the  takeoff,  GCA, 
and  overhead  pattern  maneuvers. 

As  shown  in  Table  6,  none  of  the  multivariate 
omnibus  tests  were  significant  at  p<.05. 

In  the  univariate  analysis,  the  variables 
measured  in  the  takeoff  maneuver  consistently 
pointed  towards  better  performance  under  the  full 
FOV.  A majority  of  the  dependent  measures  in  the 
GCA,  also  suggested  improved  performance  under 
the  full  FOV  although  less  strongly  than  did  the 
takeoff  maneuver.  The  overhead  pattern  produced 
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TaWe  5.  Turbulence  Main  Effects  Across  Takeoff,  GCA, 
and  Overhead  Pattern  Maneuvers 


Sourc* 

X (Non*) 

X (Light)  X (Modtrat*)  SSBET 

SSW/IN 

F 

P 

Takeoff 

Heading  Deviation 

3.32 

3.46 

3.39 

.710 

672 

.112 

.894 

Pitch  Deviation 

1.92 

1.86 

1.71 

1.61 

115 

1.49 

.226 

Course  Deviation 

1.01 

1.24 

1.08 

2.11 

.219 

1.03 

.361 

Airspeed  Deviation 

4.81 

5.06 

5.34 

10.2 

3570 

.305 

.737 

Elevator  Power 

2.39 

2.60 

2.67 

3.19 

112 

3.05 

.050* 

Aileron  Power 

.698 

.816 

.836 

.795 

57.8 

1.47 

.233 

Rudder  Power 

.374 

.402 

.485 

.484 

25.2 

2.04 

.132 

Wilks  Lambda 

dfi 

df2 

P(F>F0) 

.922 

14 

414 

.2576 

GCA 

Total  Score 

26.5 

22.7 

25.1 

506 

25,800 

2.09 

.126 

Touchdown  Score 

82.5 

82.6 

85.7 

503 

30,600 

1,75 

.177 

Altitude  Deviation 

34.6 

40.3 

43.9 

3,170 

88,800 

3.80 

.024* 

Airspeed  Deviation 

2.02 

2.62 

3.13 

43.9 

314 

14.8 

.000* 

Centerline  Deviation 

102 

105 

98.7 

1310 

285,000 

.491 

.612 

Glidepath  Deviation 

33.9 

36.5 

37.4 

472 

42,900 

1.17 

.311 

Elevator  Power 

.351 

.452 

.543 

1.34 

11.0 

12.9 

.000* 

Aileron  Power 

.383 

.477 

.533 

.822 

29.6 

2.96 

.054 

Rudder  Power 

.070 

.109 

.147 

.213 

4.95 

4.59 

.011* 

Elevator  Power 

3.82 

4.03 

4.75 

34.2 

1,350 

2.71 

.069 

Aileron  Power 

1.76 

1.58 

1.68 

1.24 

406 

.325 

.723 

Rudder  Power 

8.03 

7.43 

9.12 

106 

18,000 

.627 

.535 

Wilks  Lambda 

df, 

df2 

P(F>F„) 

.708 

24 

404 

.000* 

Overhead  Pattern 

Pitchout  Altitude  Deviation 

41.5 

45.0 

38.8 

1380 

171,000 

.861 

.424 

Pitchout  Bank  Deviation 

10.6 

11.1 

10.3 

23.5 

6,750 

.371 

.690 

Elevator  Power 

1.77 

2.00 

1.88 

1.90 

363 

.556 

.575 

Aileron  Power 

.527 

.543 

.547 

.016 

42.8 

.039 

.962 

Rudder  Power 

.041 

.095 

.081 

.116 

9.69 

1.27 

.282 

Downwind  Altitude  Deviation 

37.4 

38.8 

44.3 

1,920 

122,000 

1.67 

.190 

Downwind  Score 

71.5 

66.3 

66.2 

3.080 

134,000 

2.45 

.088 

Elevator  Power 

1.96 

2.07 

2.22 

2.56 

303 

.899 

.408 

Aileron  Power 

1.16 

1.28 

1.21 

.545 

221 

.262 

.770 

Rudder  Power 

.041 

.115 

.144 

.402 

6.66 

6.42 

.002* 

Final  Turn  Bank  Deviation 

11.0 

10,5 

10.1 

26.1 

5,210 

.534 

.587 

Final  Turn  Airspeed  Dev 

5.56 

5,99 

5.96 

8.49 

3,130 

.289 

.750 

Elevator  Power 

1.52 

1.67 

1.70 

1.39 

276 

.535 

.586 

Aileron  Power 

.738 

.838 

.846 

.521 

53.0 

1.05 

.352 

Rudder  Power 

.367 

,449 

.449 

329 

119 

.294 

.745 

Glidepath  Deviation 

1.05 

1.28 

1.12 

1.88 

291 

.087 

.504 

Centerline  Deviation 

141 

138 

1 16 

27,000 

13,600,000 

.211 

810 

Final  Airspeed  Deviation 

4.54 

4.18 

5.67 

87/. 

3,320 

2.80 

.063 

Final  Score 

11.1 

9.46 

10.2 

103 

78,800 

.139 

.870 

Elevator  Power 

2.89 

3.00 

3.17 

2.85 

558 

.544 

.581 

Aileron  Power 

1.93 

1.88 

2.05 

1.15 

355 

.346 

.708 

Rudder  Power 

3.36 

3.83 

4.78 

75.4 

3.110 

2.58 

.077 

Landing  Score 

76.4 

753 

77.6 

193 

23,600 

.869 

.421 

Wilks  Lambda 

df, 

df, 

P(F>F0) 

.755 

46 

382 

.133 

Not*.  — All  urivariatc  F ratios  evaluated  jt  F,,, , ,, 
*p  < .05 
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Table  4.  Ceiling/Visibility  Main  Effects  Across  Takeoff, 
GCA,  and  Overhead  Maneuvers 


Sou''. 

x (dear) 

x (minimum*) 

SSBET 

SSW/IN 

F 

P 

Takeoff 

Heading  Deviation 

3.01 

3.77 

30.9 

642 

10.3 

.002* 

Pitch  Deviation 

1.79 

1.87 

.350 

116 

.646 

.423 

Course  Deviation 

1.07 

1.15 

.388 

221 

.376 

.541 

Airspeed  Deviation 

3.68 

6.46 

4-19 

3160 

28.4 

.000* 

Elevator  Power 

2.45 

2.65 

2.18 

113 

4.14 

.043* 

Aileron  Power 

.720 

.847 

.873 

57.7 

3.24 

.073 

Rudder  Power 

.430 

.411 

.018 

25.7 

.153 

.696 

Wilks  Lambda 

df, 

df2 

P(F>Fo) 

.840 

7 

GCA 

208 

.000* 

Total  Score 

26.9 

22.6 

1020 

25200 

8.66 

.004* 

Touchdown  Score 

84.9 

82.2 

390 

30700 

2.72 

.101 

Altitude  Deviation 

40.4 

38.8 

146 

91800 

.340 

.561 

Airspeed  Deviation 

2.59 

2.59 

.003 

358 

.002 

.962 

Centerline  Deviation 

95.0 

108 

9520 

277000 

7.36 

.008* 

Glidepath  Deviation 

34.7 

37.2 

358 

43000 

1.78 

.184 

Elevator  Power 

.429 

469 

.087 

12.2 

1.53 

.218 

Aileron  Power 

.464 

.464 

.003 

30.4 

.000 

.988 

Rudder  Power 

.108 

.109 

.000 

5.16 

.000 

.986 

Elevator  Power 

4.28 

4.11 

1.51 

1380 

.234 

.629 

Aileron  Power 

1.54 

1.81 

3.74 

404 

1.98 

.161 

Rudder  Power 

8.22 

8.17 

.129 

18100 

.002 

.969 

Wilks  Lambda 

df, 

dfj 

.896 

12 

203 

.029* 

Overhead  Pattern 

Pitchout  Altitude  Deviation 

36.3 

47.3 

6,540 

166,000 

8.43 

.004* 

Pitchout  Bank  Deviation 

11.4 

9.95 

117 

6,650 

3.75 

.054 

Elevator  Power 

1.81 

1.97 

1.40 

364 

.823 

.365 

Aileron  Power 

.475 

.603 

.886 

41.9 

4.52 

.035* 

Rudder  Power 

.083 

.062 

.024 

9.78 

.524 

.469 

Downwind  Altitude  Deviation 

35.8 

44.6 

4,150 

1 19,000 

7.43 

.007* 

Downwind  Score 

70.4 

62.9 

3,020 

134,000 

4.82 

.029* 

Elevator  Power 

1.71 

2.46 

30.2 

275 

23.47 

.000* 

Aileron  Power 

1.07 

1.36 

4.46 

217 

4.40 

.037* 

Rudder  Power 

.106 

.094 

.008 

7.06 

.239 

.626 

Final  Turn  Bank  Deviation 

9.83 

11.20 

108 

5,130 

4.49 

.035* 

Airspeed  Deviation 

5,07 

6.60 

126 

3,020 

8.93 

.003* 

Elevator  Power 

1.47 

1.79 

5.61 

272 

4.41 

.036* 

Aileron  Power 

.745 

.870 

.852 

52.7 

3.46 

.064 

Rudder  Power 

.515 

.328 

1.90 

117 

3.45 

.064 

Glidepath  Deviation 

1.09 

1.22 

927 

292 

.678 

.411 

Centerline  Deviation 

110 

154 

107,000 

13,600,000 

1.68 

.196 

Final  Airspeed  Deviation 

4.23 

5.37 

70.8 

3,340 

4.54 

.034* 

Final  Score 

12.7 

7.87 

1,250 

77,700 

3.45 

.064 

Elevator  Power 

2.86 

3.18 

5.50 

555 

2.12 

.146 

Aileron  Power 

1.77 

2.14 

7.58 

3.49 

4.65 

.032* 

Rudder  Power 

3.63 

4.35 

28.4 

3,150 

1.93 

.168 

Landing  Score 

77.1 

75.8 

87.2 

23,700 

.786 

.376 

Wilks  Lambda 

df, 

df2 

P(E>E0) 

.754 

23 

192 

.000* 

Note.  — All  univariate  F's  t\alu  itai  at  1 
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Table  5.  Motion  Main  Effect  Across  Takeoff, 
GCA,  and  Overhead  Pattern  Maneuvers 


Sourc* 

x{0  DOF) 

X(3  DOF) 

x(6  DOF) 

SSBET 

SSW/IN 

F 

P 

Takeoff 

Heading  Deviation 

3.33 

3.42 

3.41 

.377 

672 

.060 

.942 

Pitch  Deviation 

1.70 

1.96 

1.83 

239 

114 

2.24 

.109 

Course  Deviation 

1.30 

1.03 

1.00 

3.83 

218 

1.87 

.156 

Airspeed  Deviation 

4.12 

5.81 

5.28 

107 

3,470 

3.29 

.039 

Elevator  Power 

2.52 

2.48 

2.67 

1.47 

113 

1.38 

.254 

Aileron  Power 

.582 

.801 

.967 

538 

53.2 

10.77 

.000* 

Rudder  Power 

.487 

.346 

.428 

.719 

25.0 

3.07 

.048* 

Wilks  Lambda 

df, 

1 

df2 

p(F>F  o) 

.823 

14 

414 

.000* 

GCA 

Total  Score 

27.3 

24.3 

22.7 

771 

25,500 

3.23 

.042* 

Touchdown  Score 

84.4 

83.4 

82.9 

86.8 

31,100 

.298 

.743 

Altitude  r'*>viation 

33.2 

41.2 

44.3 

4,720 

87,300 

5.76 

.004* 

Airspeed  Deviation 

2.40 

2.44 

2.92 

12.0 

346 

3.70 

.026* 

Centerline  Deviation 

96.7 

102 

106 

3,060 

283,000 

1.15 

.319 

Glidcpath  Deviation 

36.3 

35.6 

36.0 

19.6 

43,400 

.048 

.953 

Aileron  Power 

.379 

.395 

.572 

1.66 

10.7 

16.6 

.000* 

Rudder  Power 

.276 

.457 

.660 

5.31 

25.1 

22.5 

.000* 

Elevator  Power 

.091 

.113 

.123 

.039 

5.12 

.806 

.448 

Aileron  Power 

4.29 

3.70 

4.61 

30.9 

1,350 

2.44 

.089 

Rudder  Power 

1.53 

1.43 

2.06 

16.9 

390 

4.61 

.001* 

Elevator  Power 

8.56 

6.83 

9.20 

216 

17,900 

1.29 

.278 

Wilks  Lambda 

df 

df2 

p(F>F0) 

.695 

24 

404 

.000* 

Overhead  Pattern 

Pitchout  Altitude  Deviation 

36.9 

40.6 

47.8 

4390 

168000 

2.78 

.064 

Pitchov.t  Bank  Deviation 

10.1 

11.2 

10.8 

39.5 

6730 

.625 

.536 

Elevator  Power 

2.16 

1.72 

1.79 

8.16 

357 

2.43 

.090 

Aileron  Power 

.439 

.513 

.666 

1.93 

40.9 

5.02 

.007* 

Rudder  Power 

.062 

.069 

.087 

:024 

9.78 

.258 

.773 

Downwind  Altitude  Deviation 

34.0 

41.4 

45.3 

4750 

119000 

4.26 

.015* 

Downwind  Score 

70.2 

65.5 

64.2 

1430 

135000 

1.12 

.327 

Elevator  Power 

2.22 

1.74 

23.0 

13.0 

292 

4.74 

.009* 

Aileron  Power 

.895 

1.17 

15.8 

17.0 

205 

8.85 

.000* 

Rudder  Power 

.098 

.110 

.092 

.013 

7.05 

.191 

.826 

Final  Turn  Bank  Deviation 

9.95 

10.6 

11.0 

43.9 

5200 

.899 

.409 

Final  Turn  Airspeed  Deviation 

5.68 

6.14 

5.69 

9.74 

3130 

.331 

.719 

Elevator  Power 

1.55 

1.47 

1.88 

6.59 

271 

2.59 

.077 

Aileron  Power 

.605 

.830 

.987 

5.31 

58.2 

11.73 

.000* 

Rudder  Power 

.483 

.418 

.365 

.504 

119 

.452 

.637 

Glidcpath  Deviation 

1.14 

1.12 

1.20 

.233 

293 

.085 

.919 

Centerline  Deviation 

128 

134 

134 

1,810 

13,700,000 

.014 

.986 

Final  Airspeed  Deviation 

4.88 

4.73 

4.79 

.867 

3140 

.027 

.973 

Final  Score 

8.20 

12.2 

10.5 

574 

78300 

.781 

.459 

Elevator  Power 

3.28 

2.74 

3.04 

10.6 

550 

2.053 

.131 

Aileron  Power 

1.70 

2.05 

2.12 

7.28 

349 

2.20 

.111 

Rudder  Power 

4.40 

3.48 

4.09 

31.0 

3150 

1.05 

.352 

Landing  Score 

78.1 

76.2 

/ 5.2 

314 

23500 

1.42 

.244 

Wilks  Lambda 

df, 

df2 

P(F>F0) 

.657 

46 

382 

.000* 

*p  < .05. 

AH  umvanatc  F's  evaluated  at  l72>213* 
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Table  6.  Field  of  View  Main  Effects  Across  Takeoffs, 
GCAs,  and  Overhead  Pattern  Maneuvers 


Source 

X (masked) 

X (full) 

SSBET 

SSW/IN 

F 

P 

Takeoff 

Heading  Deviation 

3 50 

3.28 

2.72 

670 

.869 

.353 

Pitch  Attitude  1 .8i 

1.86 

1.80 

.150 

116 

.277 

.599 

Course  Deviation 

1.23 

.993 

2.96 

219 

2. '90 

.089 

Airspeed  Deviatin') 

5.52 

4.62 

43.5 

3,530 

2.63 

.106 

Elevator  Power 

2.61 

2.50 

.615 

114 

1.152 

284 

Rudder  Power 

.868 

.698 

.156 

57.0 

5.85 

.016* 

Airlcron  Power 

.428 

.413 

.013 

25.7 

107 

.744 

Wilks  Lambda 

df, 

df. 

P(F>F0) 

.949 

7 

203 

.141 

GCA 

Total  Score 

25.1 

24.5 

18.7 

26,200 

.153 

.696 

Touchdown  Score 

83.0 

84.2 

88.5 

31,000 

.610 

.436 

Altitude  Deviation 

42.0 

37.2 

1,260 

90,700 

2.96 

.086 

Airspeed  Deviation 

27.1 

24.6 

3.35 

355 

2.02 

.157 

Centerline  Deviation 

99.4 

104 

1,150 

285,000 

.867 

.353 

Glidepath  Deviation 

34.8 

37.1 

298 

43,100 

1.48 

.225 

Elevator  Power 

.472 

.425 

.122 

12.2 

2.14 

.145 

Aileron  Power 

.530 

.398 

.938 

29.4 

6.82 

.009* 

Rudder  Power 

.102 

.115 

.008 

5.15 

333 

.564 

Elevator  Power 

4.18 

4.21 

.061 

1,380 

.009 

.922 

Aileron  Power 

1.76 

1.58 

1.77 

406 

.934 

.335 

Rudder  Power 

8.72 

7.67 

60.4 

18,000 

.718 

.398 

Wilks  Lambda 

df, 

df. 

P(F>F„) 

.922 

12 

203 

.155 

Overhead  Pattern 

Pitchout  Altitude 

44.1 

39.4 

1 ,3.00 

171,000 

1.50 

.221 

Pitchout  Bank 

11.0 

10.4 

23.0 

6,750 

.731 

.394 

Elevator  Power 

1.87 

1.91 

.081 

365 

.047 

.828 

Aileron  Power 

.595 

.483 

.681 

42.1 

3.46 

.069 

Rudder  Power 

.087 

.058 

.045 

9.76 

.977 

.329 

Downwind  Attitude  Deviation 

41.1 

39.3 

164 

123,000 

.284 

.595 

Downwind  Score 

62.9. 

70.5 

3,130 

134,000 

5.01 

.026* 

Elevator  Power 

2.13 

2.04 

.519 

305 

.364 

.547 

Aileron  Power 

1.34 

1.09 

3.16 

218 

3.09 

.080 

Rudder  Power 

.092 

.108 

.013 

7.05 

.397 

.530 

Final  Turn  Bank  Deviation 

11.5 

9.62 

181 

5.060 

7.67 

.006* 

Final  Turn  Airspeed  Deviation 

5.75 

5.92 

1.57 

3,140 

.107 

.744 

Elevator  Power 

1.65 

1.62 

.054 

278 

.042 

.839 

Aileron  Power 

.891 

.724 

1.51 

52.0 

6.19 

.014* 

Rudder  Power 

.404 

.439 

.064 

119 

.114 

.735 

Glidepath  Deviation 

1.26 

1.04 

2.67 

291 

1.97 

.162 

Centerline  Deviation 

165 

99.1 

233,000 

1,340,000 

3.71 

.055 

Final  Airspeed  Deviation 

5.51 

4.09 

108 

3,300 

7.01 

.009* 

Final  Score 

9.24 

11.3 

233 

78,700 

.635 

.426 

Elevator  Power 

3.02 

3.03 

.006 

560 

.002 

.962 

Aileron  Power 

2.07 

1.84 

2.76 

354 

1.67 

.198 

Rudder  Power 

4 02 

3.96 

151 

3,180 

.010 

.919 

Landing  Score 

76.4 

76  6 

2.61 

23,800 

.023 

.878 

Wilks  Lambda 

dl, 

df. 

P(F>F0) 

843 

23 

192 

.0572 

Note.  — All  Univariate  1 \ evaluated  at  1 l%214 
* p ^ OS. 


few  cases  of  significance  in  the  univariate  analysis. 
Eighteen  of  the  23  vanables  measured  in  the  over- 
head pattern  showed  better,  although  not 
necessarily  significantly  better,  performance  under 
the  full  FOV. 

G-Seat.  The  final  system  main  effect  evaluated 
was  the  G-seat.  The  data  analyses  on  the  G-seat 
variable  are  listed  in  Table  7. 

The  G-seat  variable  reached  significance  in  the 
omnibus  multivariate  test  for  the  takeoff  and  GCA 
maneuvers,  but  not  for  the  overhead  pattern. 

Inspection  of  the  univariate  analysis  data  in 
Table  7 reveals  three  significant  F ratios  (p<05) 
for  the  takeoff  maneuver.  Overall,  three  of  the 
seven  dependent  measures  show  improved 
performance  with  the  G-seat  present. 

The  GCA  maneuver  produced  two  significant 
univariate  F ratios,  both  of  which  indicated  better 
performance  with  the  G-seat  on.  Of  the  12 
variables  in  the  matrix,  although  only  these  two 
were  significant,  seven  of  the  12  suggested 
improved  performance  under  the  G-scat  on 
condition. 

In  the  overhead  pattern  maneuver,  13  of  23 
variables  favored  the  G-seat  condition;  however, 
the  effect  was  so  small  that  overall  performance 
was  relatively  unchanged  as  a function  of  G-seat 
conditions. 

The  maneuvers  used  in  the  second  design  were 
slow  flight  and  aileron  roll.  The  independent 
variables  manipulated  in  the  perfonnance  of  these 
tasks  were  turbulence,  platform  motion,  FOV,  and 
G-seat. 

3*  Environmental  Variable.  Table  8 lists  the 
means,  sums  of  squares,  univariate  F-statistics,  and 
associated  probability  levels  for  the  single  environ- 
mental variable  (turbulence)  investigated  in  tire 
slow  flight  and  aileron  roll  maneuvers.  As  can  be 
discerned  from  inspection  of  these  tables,  the 
omnibus  ‘tests  were  nonsignificant;  however, 
examination  of  the  individual  variable  means  dis- 
closed that  four  of  the  seven  dependent  measures 
in  slow  flight  suggested  that  superior  performance 
was  evidenced  under  no  turbulence  conditions. 
Contrary  to  this  finding,  seven  of  the  eight 
dependent  measures  used  in  the  aileron  roll 
suggested  that  performance  improved  when  some 
level  of  turbulence  was  present. 

3*  System  Variables.  Table  9 lists  the  effects 
observed  when  the  system  configuration  variables 
were  analyzed. 


Of  the  three  system  main  effects  evaluated  by 
multivariate  techniques  in  the  slow  flight 
maneuver,  the  most  prominent  was  the  motion 
effect  (p<.001).  Those  variables  which  attained 
significance  in  the  univariate  analysis  also 
indicated  that  subject  performance  was  superior  in 
the  absence  of  platform  motion. 

The  FOV  and  the  G-seat  variables  produced 
mixed  results  in  the  slow  flight  maneuver  as 
evidenced  by  the  nonsignificant  multivariate  and 
univariate  tests  (Table  9).  Surprisingly,  the 
majority  of  the  dependent  measures  in  the  slow 
flight  maneuver  suggested  that  superior 
performance  was  evidenced  in  the  masked  FOV 
condition. 

The  FOV  main  effect  was  significant  in  the 
multivariate  analysis  of  pilot  performance  of  the 
aileron  roll.  The  step-down  univariate  analysis 
confirmed  this  effect  with  a majority  of  the 
system  output  and  pilot  input  dependent  measures 
reflecting  improved  performance  under  the  full 
FOV  condition. 

The  G-seat  main  effect  did  not  attain  statistical 
significance  in  this  maneuver  for  either  the  multi- 
variate analysis  or  for  any  of  the  individual 
measures  at  the  univariate  level. 

Environmental  by  Environmental 
Variable  Interactions  in  the  33  23  Design 

None  of  the  environmental  by  environmental 
variable  interactions  reached  significance  in  the 
omnibus  tests  for  any  of  the  three  maneuvers.  This 
obvious  lack  of  synergistic  effects  between 
environmental  factors  was  somewhat  surprising 
and  will  be  pursued  in  the  Discussion  Section. 

System  by  System  Variable 
Interactions  in  the  33  23  Design 

The  system  variables,  consisting  of  platform 
motion,  FOV,  and  G-seat,  produced  the  inter- 
actions shown  in  Table  10. 

Considering  all  three  maneuvers  used  in  this 
design,  only  two  of  the  three  possible  first  order 
interactions  of  the  system  variables  attainer. 
statistical  significance.  The  FOV  by  G-seat  *n ter- 
action  did  not  leacli  significance  in  any  o.  the 
three  maneuvers 

Motion  by  FOV.  The  motion  by  FOV 
interaction  was  statistically  significant  m the 
multivariate  analysis  for  both  liie  takeoff  and  GCA 
maneuvers.  Table  11  and  12  give  tire  dependent 


Table  7.  G-Seat  Main  Effects  Across  Takeoffs, 
GCAs,  and  Overhead  Pattern  Maneuvers 


Sourc*  x (Off)  x (On)  SSBET  SSW/IN  F p 


Heading  Deviation 
Pitch  Attitude 
Course  Deviation 
Airspeed  Deviation 
Elevator  Power 
Rudder  Power 
Aileron  Power 

Wilks  Lambda 
.909 


Total  Score 
Touchdown  Score 
Altitude  Deviation 
Airspeed  Deviation 
Centerline  Deviation 
Glidepath  Deviation 
Elevator  Power 
Aileron  Power 
Rudder  Power 
Elevator  Power 
Aileron  Power 
Rudder  Power 

Wilks  Lambda 
.855 


Pitchout  Altitude 
Pitchout  Bank 
Elevator  Power 
Aileron  Power 
Rudder  Power 

Downwind  Altitude  Deviation 

Downwind  Score 

Elevator  Power 

Aileron  Power 

Rudder  Power 

Final  Turn  Bank  Deviation 

Final  Turn  Airspeed  Deviation 

Elevator  Power 

Aileron  Power 

Rudder  Power 

Glidepath  Deviation 

Centerline  Deviation 

Final  Airspeed  Deviation 

Final  Score 

Elevator  Power 

Aileron  Power 

Rudder  Power 

Landing  Score 

Wilks  Lambda 
.864 


Takeoff 

3.34 

3.44 

.594 

1.96 

1.70 

3.63 

1.02 

1.20 

1.66 

5.63 

4.51 

68.0 

2.47 

2.63 

1.36 

.825 

.741 

.376 

.367 

.474 

df, 

7 

GCA 

.619 

23.5 

26.0 

355 

84.0 

83.2 

37.5 

44.0 

35.2 

4,240 

2.70 

2.48 

2.76 

108 

95.3 

8,760 

37.3 

34.6 

414 

.425 

.472 

.118 

.483 

.445 

.075 

.113 

.104 

.005 

3.97 

4.42 

11.1 

1.66 

1.69 

.035 

7.77 

8.62  39.4 

df, 

12 

Overhead  Pattern 

42.3 

41.3 

52.9 

11.7 

9.67 

221 

1.68 

2.09 

9.19 

.525 

.553 

.042 

.062 

.083 

.025 

40.8 

39.6 

72.6 

67.2 

66.1 

63.7 

1.94 

2.23 

4.27 

1.16 

1.27 

.721 

.116 

.084 

.053 

10.6 

10.5 

1.34 

5.89 

5.78 

.738 

1.52 

1.74 

2.73 

.816 

.799 

.017 

.411 

.432 

.023 

1.27 

1.03 

3.14 

159 

105 

153,000 

4.89 

4.71 

1.77 

12.5 

8.05 

1,080 

2.78 

3.27 

1,229 

2.03 

1.87 

1.36 

4.00 

3.98 

.040 

76.0 

V.O 

df, 

23 

54.0 

672 

.189 

.664 

113 

6.91 

.009* 

220 

1.62 

.205 

3,510 

4.15 

.043* 

113 

2,559 

.111 

58.2 

1.38 

.241 

25.1 

5.28 

.022* 

df2 

P(F>F0) 

208 

.005* 

25,900 

2.93 

.088 

31,100 

.258 

.612 

87,800 

10.2 

.002* 

356 

1.66 

.199 

277,000 

6.76 

.010* 

43,000 

2.06 

.152 

12.2 

2.07 

.151 

30.3 

.529 

.468 

5.16 

.186 

.666 

1,370 

1.73 

.189 

407 

.018 

.893 

18,000 

.468 

.495 

df2 

P(F>F0) 

203 

.001* 

172,000 

.066 

.798 

6,550 

7.23 

.008* 

356 

5.53 

.020* 

42.8 

.208 

.649 

9.78 

.553 

.458 

124,000 

.126 

.723 

137,000 

.100 

.753 

301 

3.04 

.083 

221 

.698 

.404 

7.01 

1.599 

,207 

5,240 

.055 

.815 

3,140 

.050 

.822 

275 

2.126 

.146 

53.5 

.067 

.796 

119 

.041 

.840 

290 

2.32 

.130 

1,350,000 

2.43 

.121 

3,410 

.111 

.739 

77,800 

2.96 

.087 

548 

5.05 

.026* 

355 

.821 

.366 

3,180 

.003 

.958 

23,800 

.487 

.486 

df2 

P(F>Fo) 

192 

.159 

Not*.-  All  univariate  Fsevalutedat  F,l214. 
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Note.  — All  univariate  F*s  evaluated  at  ^2,78" 

*P  < .05. 

Mod  = Moderate 


Table  9 ( Continued ) 


Source 

x(Oft) 

x (SP  Only) 

it  (On) 

SSBET 

SSW/IN 

F 

p 

G-Seat 

Bank  In  Deviation 

2.17 

2.12 

1.87 

1.39 

149 

.363 

.696 

Roll  Acceleration 

13.1 

12.9 

12.5 

7.53 

3,690 

.080 

.924 

Roll  Score 

42.8 

36.3 

36.4 

761 

38,600 

.769 

.467 

Bank  Out  Deviation 

3.75 

3.39 

3.32 

2.85 

214 

.520 

.596 

Aileron  Power  (In) 

2.03 

1.43 

1.60 

5.10 

263 

.756 

.473 

Aileron  Power  (Roll) 

1.49 

1.22 

1.23 

1.28 

129 

.387 

.681 

Aileron  Power  (Out) 

1.45 

1.16 

.968 

3.20 

143 

.875 

.421 

Total  Score 

29.1 

29.0 

27.2 

61.8 

32,900 

.073 

.929 

Wilks  Lambda 

df, 

df, 

P(F>F„) 

.824 

16 

142 

.570 

Note.  — All  univariate  F’s  evaluated  at 
*p  < .05. 

SP  only  — Seat  Pan  Only. 

Table  10. 

Significant  System  by  System  Variable  Interactions 
Across  All  Maneuvers 

Sou  roe 

Wilks  Lambda  (X) 

d,> 

d»2 

p(p>p0) 

Takeoff 

Motion  by  G-Seat 

.667 

14 

220 

3.52 

.000 

Motion  by  Field  of  View 

.787 

14 

220 

1.98 

.019 

GCA 

Motion  by  Field  of  View 

.585 

2fr 

210 

2.69 

.000 

Overhead  Pattern 

Motion  by  G-Seat 

.494 

46 

188 

1.72 

.006 

Table  11.  Field  of  View  by  Motion  Interaction  Cell  Means  for  Takeoff 


Souree 

Fltld  of  Vltw  (fuM) 

Flald  of  Vlaw  (matkta) 

i 

o 

O o 

3 

DOF 

s 

DOF 

0 

OOF 

3 

DOF 

6 

DOF 

1.  Heading  Deviation 

3.24 

3.55 

3.69 

3.41 

3.28 

3.13 

2.  To/ Att  Deviation 

1.04 

1.97 

1.75 

1.56 

1.93 

1.91 

3.  Course  Deviation 

1.63 

1.05 

1.00 

.96 

1.01 

1.00 

4.  Airspeed  Deviation 

4.61 

5.72 

6.22 

3.63 

5.90 

4.32 

5.  Elevator  Power 

2.46 

2.49 

2.86 

2.57 

2.45 

2.47 

6.  Aileron  Power 

.57 

.88 

1.15 

.59 

.72 

.78 

7.  Rudder  Power 

.46 

.35 

.47 

.51 

.34 

.38 

No*#.  — DOF  = degree*  of  freedom,  motion  platform. 
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Table  9 ( Continued ) 


Source 

*{Off) 

x (SP  Only) 

x(On) 

SSBET 

SSW/IN 

F 

P 

G-Seat 

Bank  In  Deviation 

2.17 

2.12 

1.87 

1.39 

149 

.363 

.696 

Roll  Acceleration 

13.1 

12.9 

12.5 

7.53 

3,690 

.080 

.924 

Roll  Score 

42.8 

36.3 

36.4 

761 

38,600 

.769 

.467 

Bank  Out  Deviation 

3.75 

3.39 

3.32 

2.85 

214 

.520 

.596 

Aileron  Power  (In) 

2.03 

1.43 

1.60 

5.10 

263 

.756 

.473 

Aileron  Power  (Roll) 

1.49 

1.22 

1.23 

1.28 

129 

.387 

.681 

Aileron  Power  (Out) 

1.45 

1.16 

.968 

3.20 

143 

.875 

.421 

Total  Score 

29.1 

29.0 

27.2 

61.8 

32,900 

.073 

.929 

Wilks  Lambda 

df, 

p(F>F0) 

.824 

16 

142 

.570 

Not#.  — All  univariate  F’s  evaluated  at  F2J8- 
*p  < .05. 

SP  only  -=  Seat  Pan  Only. 

Table  10. 

Significant  System  by  System  Variable  Interactions 
Across  All  Maneuvers 

Souroe 

Wilks  Lambda  (X) 

d»3 

Fo 

P(F>P„) 

Takeoff 

Motion  by  G-Seat 

.667 

14 

220 

3.52 

.000 

Motion  by  Field  of  View 

.787 

14 

220 

1.98 

.019 

GCA 

Motion  by  Field  of  View 

.585 

2*r 

210 

2.69 

.000 

Overhead  Pattern 

Motion  by  G-Seat 

.494 

46 

188 

1.72 

.006 

Table  1 1.  Field  of  View  by  Motion  Interaction  Cell  Means  for  Takeoff 


Souroe 

Field  of  View  (fuN) 

Field  of  View  (masked) 

1 

□ 

O o 

■4. 

3 

DOF 

« 

DOF 

0 

DOF 

3 

OOF 

s 

DOF 

1.  Heading  Deviation 

3.24 

3.55 

3.69 

3.41 

3.28 

3.13 

2.  To/Att  Deviation 

1.04 

1.97 

1.75 

1.56 

1.93 

1.91 

3.  Course  Deviation 

1.63 

1.05 

1.00 

.96 

1.01 

1.00 

4.  Airspeed  Deviation 

4.61 

5.72 

6.22 

3.63 

5.90 

4.32 

5.  Elevator  Power 

2.46 

2.49 

2,86 

2.57 

2.45 

2.47 

6.  Aileron  Power 

.57 

.88 

1.15 

.59 

.72 

.78 

7.  Rudder  Power 

.46 

.35 

.47 

.51 

.34 

.38 

Nod*.  — DOF  = degrees  of  freedom,  motion  platform. 
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Table  12.  Motion  by  Field  of  View  Interaction  Cell  Means  for  GCA 


Source 

Full  Field  of  View 

M»ke0  Field  of  View 

0 DOF 
Motion 

3 

DOF 

6 

DOF 

0 DOF 
Motion 

3 

S3F 

s 

DOF 

1. 

Total  Score 

28.15 

23.92 

23.07 

26.39 

24.62 

22.37 

2. 

Touchdown 

83.74 

84.15 

80.94 

85.12 

82.70 

84.86 

3. 

Altitude  Deviation 

53.20 

44.14 

46.65 

31.22 

38.33 

41.94 

4. 

Airspeed  Deviation 

2.47 

2.63 

3.Q2 

233 

2.24 

2.81 

5. 

Centerline  Deviation 

95.47 

100.46 

102.12 

97.93 

104.52 

109.48 

6. 

Ghdepath  Deviation 

34.91 

36.48 

32.94 

37.67 

34.63 

39.08 

7. 

Elevator  Power 

.38 

.41 

.61 

.36 

.37 

.53 

8. 

Aileron  Power 

.25 

.49 

.83 

.29 

.41 

.48 

9. 

Rudder  Power 

.07 

.07 

.15 

.10 

.14 

.08 

10. 

Elevator  Power 

3.92 

3.40 

5.21 

4.64 

3.98 

4.00 

11. 

Aileron  Power 

1.36 

1.56 

236 

1.69 

1.29 

1 76 

12. 

Rudder  Power 

7.47 

7.54 

11.13 

9.62 

6.11 

7.25 

variables  means  for  the  treatment  cells  of  both 
maneuvers.  Table  13  gives  ratings  of  the  mean 
performance  for  these  maneuvers.  Inspection  of 
this  table  reveals  best  performance  falling  in  the  no 
motion,  full  FOV  condition  in  the  GCA.  In  this 
maneuver,  performance  generally  deteriorates  with 
the  introduction  of  platform  motion.  The  same 
deterioration  in  pcrfonnance  occurred  in  the  take- 


off maneuver  under  the  three  and  six  DOF 
platform  motion  conditions.  Tire  analysis  of  the 
data  from  both  maneuvers  suggests  that  superior 
performance  occurred  under  the  masked  FOV 
condition.  Tire  best  performance  in  the  takeoff 
maneuver  occurred  with  the  masked  FOV,  but 
when  6 DOF  of  platform  motion  was  present. 


Table  13.  Motion  by  FOV  Interaction  Mean  Ratings 
for  the  GCA  and  Takeoff  Maneuvers 


Motion 


Motion 


GCA 

Field  of  View 


Full 

Masked 

ODOF 

2.29* 

2.83 

3 DOF 

3.37 

2.83 

6 DOF 

5.33* 

4.33 

X2  crit  = 2.99 


Tikeoff 


Full 

Masked 

ODOF 

3.00 

2.85 

5 OOF 

4.42 

3.14 

6 DOF 

4.78 

2.78 

X2  ent  = 

3.32 

'Indicates  significant  difference. 
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Table  16.  Motion  by  G-Seat  Interaction  Mean  Ratings  for  the  Takeoff 
and  Overhead  Pattern  Maneuvers 


Takeoff 
G-Seat 

ODOF 
Motion  3 DOF 

6 DOF 

X2  crit  = 3.32 

Overhead  Pattern 
G-Seat 

Off  On 

ODOF 
Motion  3 DOF 

6 DOF 

X2  crit  = 1 .82 

* Denotes  significant  difference. 


2.48* 

3.22 

3.76 

3.20 

4.37* 

3.98 

2.64 

3.28 

3.21 

3.71 

4.57 

3.57 

System  by  Environmental  Variable 
Interactions  in  the  33  23  Design 

The  third  type  of  interaction  considered  in  this 
study  was  the  system  by  environmental  variable 
interaction.  These  data  are  listed  in  Table  17. 

Of  the  nine  possible  first  order  interactions 
between  environmental  and  system  variables,  only 
three  attained  statistical  significance  in  the  multi- 
variate test. 

Turbulence  by  Motion.  Tire  turbulence  by 
motion  interaction  was  significant  in  al*  three 
maneuvers.  Table  18,  19,  and  20  present  the  treat- 
ment cell  means  across  all  dependent  variables. 

Table  21  shows  the  mean  ratings  of  perform- 
ance for  this  interaction  across  the  three 
maneuvers.  Ir.  all  cases,  best  performance  was 
demonstrated  in  the  no  motion,  no  turbulence 
conditions.  Thereafter,  pilot  performance 
consistently  became  poorer  as  turbulence  and 
platform  motio"  increased. 

C/V  by  FOV.  The  second  interaction,  ceiling 
visibility  by  FOV,  and  the  final  significant  inter- 
action of  this  type,  C/V  by  G-seat,  were 


manifested  only  within  the  analysis  of  the  GCA 
maneuver.  Table  22  gives  the  mean  performances 
for  the  C/V  by  FOV  treatment  cells. 

C/V  by  G-Seat.  As  stated  above,  this  interaction 
was  statistically  significant  only  for  the  GCA 
maneuvei.  Table  23  lists  the  mean  performance 
observed  for  the  C/V  by  G-seat  treatment  cells. 

Analysis  of  C/V  Interactions.  Table  24  shows 
the  differences  in  the  mean  ratings  for  the  two 
C/V  interactions.  In  both  instances,  superior 
performance  was  evidenced  in  the  dear  C/V 
conditions.  This  performance  was  accompanied  in 
the  first  interaction  with  the  masked  FOV,  and  in 
the  second  with  the  G-seat  being  operational. 

The  Second  Order  Interaction  in' the  33  23 
Design.  The  most  surprising  interaction  produced 
was  a second  order  interaction,  C/V  by  FOV  by 
G-seat,  that  reached  probability  levels  of 
p = <025,  p = <01,  and  p = <001  in  the  multi- 
variate analysis  oi  the  takeoff,  GCA,  and  overhead 
pattern  maneuvers,  respectively.  Tables  25, 26  and 
27  contain  the  mean  performance  data  on  these 
maneuvers.  Table  28  contains  the  mean  ratings  of 
performance  for  this  interaction  across  all  three 
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Table  16.  Motion  by  G-Seat  Interaction  Mean  Ratings  for  the  Takeoff 
and  Overhead  Pattern  Maneuvers 


Motion 


ODOF 
3 DOF 
6 DOF 


Taktoff 

G-Seat 


2.64 

3.28 

3.21 

3.71 

4.57 

3.57 

X2  crit  = 3.32 


Ovarhaad  Patlam 


ODOF 
Motion  3 DOF 
6 DOF 


‘Denotes  siEnificant  difference. 


G-Saat 

Off  On 


2.48* 

3.22 

3.76 

3.20 

4.37* 

3.98 

X2  crit  = 1.82 


System  by  Environmental  Variable 
Interactions  in  the  33  23  Design 

Tire  third  type  of  interaction  considered  in  this 
study  was  the  system  by  environmental  variable 
interaction.  These  data  are  listed  in  Table  17. 

Of  the  nine  possible  first  order  interactions 
between  environmental  and  system  variables,  only 
three  attained  statistical  significance  in  the  multi- 
variate test. 

Turbulence  by  Motion.  Tire  turbulence  by 
motion  interaction  was  significant  in  all  three 
maneuvers.  Table  18,  19,  and  20  present  the  treat- 
ment cell  means  across  all  dependent  variables. 

Table  21  shows  the  mean  ratings  of  perform- 
ance for  this  interaction  across  the  three 
maneuvers.  In  all  cases,  best  performance  was 
demonstrated  in  the  no  motion,  no  turbulence 
conditions.  Thereafter,  pilot  performance 
consistently  became  poorer  as  turbulence  and 
platform  motio"  increased. 

C/V  by  FOV.  The  second  interaction,  ceiling 
visibility  by  FOV,  and  the  final  significant  inter- 
action of  this  type,  C/V  by  G-seat,  were 


manifested  only  within  the  analysis  of  the  GCA 
maneuver.  Table  22  gives  the  mean  performances 
for  the  C/V  by  FOV  treatment  cells. 

C/V  by  G-Seat.  As  stated  above,  this  interaction 
was  statistically  significant  only  for  tire  GCA 
maneuver.  Table  23  lists  the  mean  performance 
observed  for  the  C/V  by  G-seat  treatment  cells. 

Analysis  of  C/V  Interactions.  Table  24  shows 
the  differences  in  the  mean  ratings  for  the  two 
C/V  interactions.  In  both  instances,  superior 
performance  was  evidenced  in  the  dear  C/V 
conditions.  This  performance  was  accompanied  in 
the  first  interaction  with  the  masked  FOV,  and  in 
the  second  with  the  G-seat  being  operational. 

The  Second  Order  Interaction  in' the  33  23 
Design.  The  most  surprising  interaction  produced 
was  a second  order  inteiaction,  C/V  by  FOV  by 
G-seat,  that  reached  probability  levels  of 
p = <025,  p = <01,  and  p = <001  in  the  multi- 
variate analysis  ui  the  takeoff,  GCA,  and  overhead 
pattern  maneuvers,  respectively.  Tables  25, 26  and 
27  contain  the  mean  performance  data  on  these 
maneuvers.  Table  28  contains  the  mean  ratings  of 
performance  for  this  interaction  across  all  three 
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Table  17.  Significant  System  by  Environmental  Interactions  Across  all  Maneuvers 


Wllkt 

Source 

Lambda  (X) 

Fo 

P(F>F„) 

Takeoff 

Turbulence  by  Motion 

.639 

28 

398.03 

1.877 

.005 

C/V  by  FOV  by  G 

.867 

7 

110 

2.414 

.024 

GCA 

Turbulence  by  Motion 

.480 

48 

406.50 

1.77 

.001 

C/V  by  FOV 

.774 

12 

105 

2.54 

.005 

C/V  by  G 

.774 

12 

105 

2.54 

.005 

C/V  by  FOV  by  G 

.688 

12 

105 

3.95 

.000 

Overhead  Pattern 

Turbulence  by  Motion 

.312 

92 

374.56 

1.39 

.017 

C/V  by  FOV  by  G 

.586 

23 

94 

2.88 

.000 

Slow  Flight 

None 

Aileron  Roll 

None 

C/V  = Ceiling/Visibility 
FOV  = Field  of  View 
G - G-Seat 

Table 

18.  Turbulence  by  Motion  Interaction  Cell  Means  for  Takeoff 

Sourc* 

0 

DOF  Motion 

3 

DOF  Motion 

6 

DOF  Motion 

No 

Turb 

Light 

Turb 

Mod 

Turb 

No 

Turb 

Light 

Turb 

Mod 

Turb 

No 

Turb 

Light 

Turb 

Mod 

Turb 

Heading 

3.32 

3.43 

3.22 

3.60 

3.43 

3.22 

3.01 

3.50 

3.72 

Altitude  Deviation 

1.86 

1.55 

1.68 

1.79 

2.20 

1.87 

2.09 

1.82 

1.57 

Course  Deviation 

1.13 

1.55 

1.20 

.90 

1.12 

1.05 

.98 

1.05 

.97 

Airspeed 

5.27 

3.S6 

3.82 

4.60 

6.16 

6.69 

4.54 

5.75 

5.52 

Elevator  Power 

2.29 

2.74 

2.51 

2.44 

2.42 

2.56 

2.42 

2.63 

2.94 

Aileron  Power 

.53 

.39 

.60 

.78 

.83 

.77 

.76 

1.01 

1.12 

Rudder  Power 

.38 

.48 

.58 

.26 

.38 

.39 

.47 

.33 

.48 

Not*.  — Turb  = Turbulence. 
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Table  19.  Turbulence  by  Motion  Interaction  Cell  Means  for  GCA 


Source 

0 OOF  Motion 

3 DOF  Motion 

6 OOF  Motion 

No 

Turb 

Light 

Turb 

Mod 

Turb 

No 

Turb 

Light 

Turb 

Mod 

Turb 

No 

Turb 

Light 

Turb 

Mod 

Turb 

Total  Score 

26.601 

27.23 

27.98 

25.69 

22.06 

24.16 

27.06 

18.05 

23.06 

Touchdown  Score 

83.56 

82.96 

86.76 

80.31 

83.05 

86.42 

83.50 

81.65 

83.56 

Altitude  Deviation 

30.94 

32.70 

35.99 

37.43 

37.51 

48.76 

35.35 

50.67 

46.87 

Airspeed  Deviation 

1.74 

2.42 

3.04 

2.19 

2.48 

2.64 

2.13 

2.95 

3.68 

Centerline  Deviation 

102.53 

92.23 

95.35 

101.92 

106.26 

99.29 

100.21 

115.73 

101.4b 

Glidepath  Deviation 

34.30 

35.94 

38.62 

35.32 

35.79 

35.56 

32.15 

37.85 

38.03 

Elevator  Power 

.30 

.40 

.42 

.35 

.33 

.49 

.39 

.61 

.70 

Aileron  Power 

.23 

.28 

.31 

.44 

.42 

.49 

.47 

.71 

.79 

Rudder  Power 

.07 

.07 

.12 

.05 

.09 

.18 

.08 

.15 

.13 

Elevator  Power 

4.03 

4.13 

4.69 

3.58 

3.26 

4.23 

3.84 

4.67 

5.30 

Aileron  Power 

7.44 

8.31 

9.92 

8.'4 

5.60 

6.14 

7.89 

8.38 

11.31 

Note.  — Turb  = Turbulence. 

Table  20. 

Turbulence  by  Motion  Interaction  Cell  Means  for  Overhead  Pattern 

Source 

No  Turbulence 

Light  Turbulence 

Moderete  Turbulence 

0 DOF 
Motion 

3 

DOF 

6 

DOF 

0 DOF 
Motion 

3 

DOF 

6 

DOF 

0 DOF 
Motion 

3 

DOF 

6 

DOF 

1. 

Altitude  Deviation 

38.65 

38.59 

47.36 

37.79 

44.08 

53.03 

34.32 

39.06 

42.92 

2. 

Bank  Deviation 

8.91 

11.46 

11.35 

10.94 

12.64 

9.79 

10.51 

9.36 

11.15 

3. 

Elevator  Power 

1.29 

1.64 

1.48 

2.22 

1.64 

2.13 

2.06 

1.85 

1.73 

4. 

Aileron  Power 

.45 

.63 

.49 

.48 

.39 

.75 

.37 

.51 

.74 

5. 

Rudder  Power 

.05 

.0? 

.04 

.08 

.03 

.16 

.04 

.14 

.05 

6. 

Altitude  Deviation 

35.79 

38.85 

37.64 

32.91 

38.14 

46.47 

33.18 

47.13 

52.70 

7. 

Downwind  Score 

70.17 

71.74 

72.44 

69.28 

66.32 

63.32 

71.21 

58.48 

59.65 

8. 

Elevator  Power 

2.15 

1.76 

1.95 

2.38 

1.46 

2.37 

2.11 

1.99 

2.56 

9. 

Aileron  Power 

.80 

1.29 

1.38 

.94 

1.13 

1.76 

.94 

1.09 

1.58 

10. 

Rudder  Power 

.05 

.04 

.02 

.08 

.12 

.13 

.15 

.16 

.11 

11. 

Bank  Deviation 

10.11 

11.58 

11.12 

10.27 

11.05 

10.18 

9.45 

9.18 

11.73 

12. 

Airspeed  Deviation 

4.36 

6.30 

6.00 

5.19 

7.54 

5.24 

7.47 

4.56 

5.83 

13. 

Elevator  Power 

1.32 

1.52 

1.71 

1.78 

1.47 

1.75 

1.53 

1.41 

2.16 

14. 

Aileron  Power 

.56 

.83 

.80 

.62 

.89 

.99 

.62 

.75 

1.15 

15. 

Rudder  Power 

.33 

.50 

.25 

.70 

.27 

.36 

.40 

.47 

.47 

16. 

Altitude  Deviation 

1.17 

.89 

1.09 

1.13 

1.09 

1.60 

1.11 

1.35 

.88 

17. 

Centerline  Deviation 

183.57 

96.39 

143.72 

73.68 

141.35 

200.07 

125.31 

163.29 

59.01 

18. 

Airspeed  Deviation 

5.70 

4.15 

3.77 

3.49 

3.53 

5.50 

5.44 

6.48 

5.09 

19. 

Final  Score 

5.86 

17.39 

10.17 

12.90 

10.09 

5.36 

5.82 

9.05 

15.85 

20. 

Elevator  Power 

3.25 

2.35 

3.07 

3.05 

2.90 

3.03 

3.53 

2.96 

3.01 

21. 

Aileron  Power 

1.59 

1.91 

2.27 

1.58 

2.12 

1.92 

1.91 

2.09 

2.14 

22. 

Rudder  Power 

3.64 

3.22 

3.20 

4.72 

3.26 

3.50 

4.81 

3.96 

5.55 

23. 

Total  Score 

80.57 

73.14 

75.90 

73.31 

75.02 

77.53 

80.36 

80.34 

72.10 

28 


Table  22.  Ceiling/Visibility  by  FOV  Interaction  Cell  Means  for  GCA 
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Source 

Full  Field  of  View 

Masked  Reid  of  View 

Clear 

Minimum* 

Clear 

Minimum* 

Total  Score 

25.51 

24.58 

2834 

20.58 

Touchdown  Score 

85.29 

80.61 

84.58 

83.88 

Altitude  RMS  Error 

46.57 

37.42 

34.23 

40.10 

Airspeed  RMS  Error 

2.82 

2.59 

2.34 

2.58 

Centerline  Deviation 

98.17 

100.54 

91.88 

116.07 

Glidepath  Deviation 

34.80 

34.75 

34.53 

39.73 

Elevator  Power 

.46 

.47 

.39 

.45 

Aileron  Power 

.57 

.48 

.35 

.44 

Rudder  Power 

.10 

.10 

.11 

.11 

Elevator  Power 

4.63 

3.72 

3.92 

4.50 

Aileron  Power 

1.78 

1.74 

1.30 

1.86 

Rudder  Power 

9.70 

7.74 

6.73 

8.59 

Table  23.  Ceiling/Visibility  by  G-Seat  Interaction  Cell  Means  for  GCA 


Source 

G-Seat  Off 

G-Seat  On 

Clair 

Minimum* 

Clear 

Minimum* 

Total  Score 

25.25 

21.69 

28.61 

23.46 

Touchdown  Score 

84.57 

33.44 

85.29 

81.05 

Altitude  RMS  Error 

49.87 

38.11 

30.93 

39.41 

Airspeed  RMS  Error 

2.72 

2.68 

2.44 

7.50 

Centerline  Deviation 

100.14 

115.93 

89.91 

100.68 

Glidepath  Deviation 

34.68  - 

37.99 

32.65 

36.49 

Elevator  Power 

.40 

.44 

.45 

.48 

Aileron  Power 

.49 

.46 

.42 

.46 

Rudder  Power 

.11 

.10 

.09 

.11 

Elevator  Power 

3.92 

4.01 

4.63 

4.21 

Aileron  Power 

1.52 

1.78 

1.54 

1.82 

Rudder  Power 

7.91 

7.61 

8.52 

8.72 
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Table  24.  Ceiling/Visibility  by  FOV  and  Ceiling/Visibility  by  G-Seat 
Interaction  Mean  Ratings  for  the  GCA  Maneuver 


Ceiling/Visibility 


Clear 

Minimums 


Clear 

Ceiling/Visibility 

Minimums 


Field  of  View 


Full 

Masked 

2.95* 

1.37*° 

2.54 

3.29° 

X2  crit  = 

1.47 

G-Seat 

Off 

On 

2.37 

1.66* 

2.70 

3.25* 

X2  crit=  1.47 

*°Denotes  significant  differences. 


Table  25.  Ceiling/Visibility  by  FOV  by  G-Seat  Interaction  Cell  Means  for  Takeoff 


G-Seat  Off  G-Seat  On 


Full  Masked  Full  Masked 

Flald  of  Vlaw  Flald  of  Vlaw  Flald  of  Vlaw  Field  of  Vlaw 


Source 

Clear 

Minimum 

Clear 

Minimum 

Clear 

Minimum 

Clear 

Minimum 

1.  Heading  Deviation 

3.08 

3.86 

2.83 

3.55 

3.12 

3.92 

2.99 

3.71 

2.  To/Att  Deviation 

1.90 

1.96 

1.92 

2.04 

1.70 

1.85 

1.62 

1.61 

3.  Course  Deviation 

.86. 

.99 

.98 

1.24 

1.53 

1.51 

.88 

.86 

4.  Airspeed  Deviation 

5.59 

6.26 

3.15 

7.51 

2.94 

7.27 

3.01 

4.79 

5.  Elevator  Power 

2.24 

2.71 

2.22 

2.71 

2.76 

2.69 

2.57 

2.49 

6.  Aileron  Power 

.96 

.85 

.57 

.90 

.70 

.92 

.62 

.69 

7.  Rudder  Power 

.42 

.32 

.31 

.39 

.54 

.40 

.42 

.51 
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Table  26.  Cefling/Visibflity  by  FOV  by  G-Seat  Interaction  Cell  Means  GCA 


G-Seat  Off 


G-Saat  On 


Full  Matked  FuH  Maakad 

Flald  of  View  Fiald  of  View  Fiald  of  Vlaw  Flald  of  View 


Source 

Clear 

Minimum 

Clear 

Minimum 

Clear 

Minimum 

Clear 

Minimum 

1.  Total  Score 

22.29 

25.15 

28.21 

18.24 

28.74 

24.02 

28.47 

22.91 

2.  Touchdown  Score 

84.52 

84.33 

84.62 

82.54 

86.05 

76.88 

84.54 

85.21 

3.  Alt  Deviation  Error 

62.04 

32.96 

37.64 

43.26 

31.10 

41.88 

30.76 

36.94 

4.  Airspeed  Deviation  Error 

3.0S 

2.58 

235 

2.77 

2.56 

2.61 

2.32 

2.39 

5.  Centerline  Deviation 

107.89 

104.17 

92.40 

127.68 

88.45 

96.90 

91.37 

104.47 

6.  Glidepath  Deviation 

37.23 

34.64 

36.13 

4134 

3238 

34.86 

32.92 

38.11 

7.  Elevator  Power 

.44 

.46 

.35 

.43 

.48 

.49 

.42 

.48 

8.  Aileron  Power 

.63 

.44 

.36 

.49 

.51 

.52 

.33 

.39 

9.  Rudder  Power 

.12 

.08 

.11 

.12 

.08 

.11 

.11 

.10 

10.  Elevator  Power 

3.84 

3.42 

4.01 

4.60 

5.42 

4.03 

3.84 

439 

1 1 . Aileron  Power 

1.96 

1.32 

1.10 

2.24 

1.60 

2.16 

1.49 

1.48 

12.  Rudder  Power 

9.35 

6.62 

6.47 

8.61 

10.04 

8.87 

7.00 

8.57 

Table  27.  CeQing/VisibDity  by  FOV  by  G-Seat  Interaction 
Cell  Means  for  Overhead  Pattern 


G-Seat  Off  G-5aat  On 


Full  Mask  ad  Full  Maikad 

Flald  of  View  Flald  of  View  Field  of  View  Field  of  Vlaw 


Source 

Clear 

Minimum 

Claar 

Minimum 

Clear 

Minimum 

Clear 

Minimum 

1 . Altitude  Deviation 

47.04 

37.45 

29.74 

54.78 

27.00 

64.98 

41.24 

31.82 

2.  Bank  Deviation 

13.93 

10.58 

12.36 

9.90 

8.74 

10.78 

10.63 

8.52 

3.  Elevator  Power 

1.16 

2.16 

1.73 

1.66- 

2.08 

2.05 

2.24 

1.98 

4.  Aileron  Power 

.47 

.69 

.37 

.56 

.62 

.59 

.43 

.55 

5.  Rudder  Power 

.06 

.06 

.06 

.04 

.16 

.05 

.02 

.08 

6.  Altitude  Deviation 

45.39 

34.77 

32.47 

50.49 

27.93 

56.19 

37.47 

36.88 

7.  Downwind  Score 

57.58 

69.38 

69.30 

62.55 

76.03 

48.41 

68.67 

7135 

8.  Elevator  Power 

1.32 

2.54 

1.59 

231 

2.11 

2.54 

1.43 

9.  Aileron  Power 

1.04 

1.29 

.82 

1.47 

1.45 

1.56 

.96 

1.11 

10.  Rudder  Power 

.14 

.07 

.11 

.13 

.07 

.07 

.09 

.08 

1 1 . Bank  Deviation 

12.03 

12.55 

7.17 

10.68 

1030 

10.90 

9.79 

10.81 

12.  Airspeed  Deviation 

4.80 

6.07 

5.27 

7.42 

5.13 

6.98 

5.06 

5.91 

13.  Elevator  Deviation 

1.20 

1.85 

1.29 

1.72 

2.00 

1.52 

137 

2.06 

14.  Aileron  Power 

.93 

.86 

.66 

.79 

.72 

1.03 

.65 

.77 

15.  Rudder  Power 

.43 

.25 

.58 

.37 

.64 

.29 

39 

.39 

16.  Altitude  Deviation 

1.46 

1.50 

.94 

1.16 

1.04 

1.02 

.88 

1.16 

17.  Centerline  Deviation 

205.9 

268.0 

42.56 

117.75 

88.88 

96.20 

101.43 

134.62 

18.  Airspeed  Deviation 

4.63 

6.87 

3.06 

4.97 

5.06 

5.44 

4.14 

4.18 

19.  Find  Score 

12.22 

11.28 

16.98 

9.55 

7.54 

5.90 

14.00 

4.74 

20.  Elevator  Power 

2.46 

3.31 

2.43 

2.89 

3.43 

2.85 

3.11 

3.66 

21.  Aileron  Power 

2.14 

2.09 

1.60 

2.29 

1.73 

2:29 

1.58 

1.88 

22.  Rudder  Power 

3.66 

4.23 

3.23 

4.87 

4.23 

3.92 

3.36 

4.37 

23.  Total  Score 

77.06 

76.32 

77.05 

73.47 

75.14 

76.94 

79.19 

76.63 

Takeoff 


G-Seat  Off  G-Seat  On 

Pull  FOV  Masked  FOV  Full  FOV  Masked  FOV 

Gear 

Ceiling  Visibility 

Minimum 

X2  crit  = 4.91 

Significant  Call  Differences:  None 


4.28 


2.43 


5.00 


2.92 


5.50 


6.07 


6.00 


3.50 


sca 

Q-Saat  Off  Q-Seat  On 

Full  FOV  Maikad  FOV  Full  FOV  Masked  FOV 

Gear 

Ceiling  Visibility 

Minimum 

X2  crit  = 3.75 

Significant  cell  Difference*:  1-4,  2-6,  4-6 
Overhead  Pattern 

G-Seat  Off  G-Seat  On 

Full  FOV  Masked  FOV  Full  FOV  Masked  FOV 

Clear 

Ceiling  Visibility 

Minimum 

X2  crit  = 2.70 

Significant  Cell  Differences:  2-5 


4.65 


2.80 


4.06 


3.32 


5.56 


5.34 


5.52 


4.60 


633 


2.83 


3.75 


2.46 


3.45 


6.70 


5.92 


4.54 


maneuvers.  Best  performance  was  demonstrated 
under  the  G-seat  off,  masked  FOV,  and  dear 
ceiling/visibility  conditions  for  two  of  the  three 
maneuvers.  Generally,  performance  became  poorer 
with  the  introduction  of  minimum  C/V  as  well  as 
introduction  of  the  full  FOV  When  considered  in 
conjunction  with  G-seat  on  condition. 

Interactions  in  the  3 4 Design. 
Environmental  by  environmental  interactions 
were  non-existent  in  the  34  design,  as 
only  one  environmental  variable  was 
utilized.  Environmental  by  system 
interactions  and  system  by  system 
interactions  were  nonsignificant  as  evaluated 
by  the  Wilks  Lambda. 

Subject  Effects 

Measures  of  subject  differences  were  obtained 
on  all  five  maneuvers.  In  both  designs,  these 
effects  showed  that  each  pilot  had  particular  areas 
of  expertise  and  sophistication;  however,  one  of 
the  three  pilots  was  more  consistently  rank 
ordered  in  the  first  position  than  the  other  two. 
The  significance  for  each  of  the  subject  effects  is 
available  in  Appendix  B where  the  MANOVA 
results  for  each  of  the  maneuvers  are  listed. 


IV.  DISCUSSION  OF  RESULTS 
Introduction 

Before  proceeding  to  the  discussion  proper,  a 
cautionary  note  must  be  sounded.  Because  of  the 
Air  Force’s  urgent  need  for  empirical  data  dealing 
with  the  material  in  this  study,  the  real  danger 
exists  that  overgeneralization  or  misgeneralization 
of  the  results  may  occur,  thus  leading  to  inap- 
propriate or  perhaps  even  incorrect  decisions. 

The  experimental  results  of  this  study  should 
be  considered  with  the  following  facts  in  mind: 

1.  This  study  dealt  only  with  experienced 
pilot  performance  so  no  generalizations  should  be 
made  to  the  naive  student  training  situation. 

2.  Performance  in  the  study  is  reflected  only 
in  scores  attained  in  the  ASPT  simulator  and  might 
in  no  way  generalize  to  either  performance  in  the 
aircraft,  another  simulator,  or  even  to  ASPT  if  it 
were  programmed  using  different  equations  of 
flight. 

3.  Generalizations  to  the  population  from 
which  the  three  subject  pilots  came  are  valid  only 
to  the  extent  that  this  small  n is  representative  of 


the  population  of  experienced  T-37  instructor 
pilots.  An  attempt  was  made  to  partially  control 
for  this  source  of  external  invalidity  through 
selection  of  the  pilots  used,  but  to  the  extent  that 
the  matching  process  was  incomplete,  the  results 
could  be  misrepresentative. 

4.  The  results  of  this  study  should  probably 
not  be  generalized  to  maneuvers  otl\er  than  those 
flown  during  the  experiment.  The  effects  of 
motion,  visual  scene  and  G-seat  are  most  likely 
quite  task  specific,  and  thus  a particular  set  of 
design  configurations  that  yielded  no  significant 
effect  on  the  five  maneuvers  tested  in  this  study 
could  have  produced  different  results  had  other 
tasks  been  tested. 

5.  The  issue  of  training  transfer  to  the  aircraft 
cannot  validly  be  addressed  based  upon  the  data 
collected  in  this  study.  Thus,  although  no  motion 
performance  was  generally  superior  to 
performance  in  either  3 DOF  or  6 DOF  motion 
configurations,  performance  could  be  better 
simply  because  it  is  easier  to  fly  the  simulator 
without  the  task  load  added  by  a moving  platform. 

6.  The  basic  purpose  of  the  study  was 
exploratory  in  nature.  Hopefully,  more  definitive 
statements  about  the  simulator  design  configura- 
tions issue  can  be  made  as  follow-on  study  results 
are  made  available. 

With  the  foregoing  as  a preamble,  the  remainder 
of  this  section  will  deal  with  an  interpretation  of 
the  experimental  findings.  The  general  approach 
will  parallel  that  used  in  the  Results  Section. 

Environmental  Variables 

Part  of  the  rationale  for  inclusion  of  environ- 
mental variables  in  this  study  was  an  attempt  to 
provide  face  validity  for  the  performance  measure- 
ment algorithms  as  currently  implemented  in 
ASPT.  Additionally,  these  variables  provided  a 
more  realistic  setting  for  the  completion  of  each 
maneuver. 

Overall,  the  environmental  variables  produced 
the  anticipated  results;  that  is,  superior  perform- 
ance as  demonstrated  by  system  output,  pilot 
input  and  derived  scores  was  generally  evidenced 
in  “clear  weather”  conditions.  Normally,  as  the 
weather  conditions  deteriorated,  so  did  the  pilots’ 
performance.  These  results  strongly  indicate  that 
the  scoring  algorithms  were  valid  and  that  they 
operated  in  the  intended  manner.  Specifically, 
only  the  turbulence  variable  failed  to  reach 
significance  in  all  of  the  maneuvers  where  it  was 
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evaluated.  This  was  not  surprising  in  that 
turbulence  is  always  present  to  some  degree  in 
actual  flight.  The  pilots,  therefore,  probabiy  had 
the  most  experience  in  adapting  to  the  disturb- 
ances produced  by  this  variable. 

System  Variables 

The  variables  of  primary  concern,  platform 
motion,  FOV  and  G-seat  all  evidenced  significant 
impact  upon  the  pilots’  performance  in  the 
simulator.  The  first  system  configuration  variable, 
platform  motion,  evidenced  significant  main 
effects  on  every  maneuver  investigated.  This 
result  provided  evidence  that  although  an 
individual  may  not  be  able  to  discern  the 
operation  or  nonoperation  of  the  motion  plat- 
form, the  status  of  the  motion  platform  directly 
affected  performance  in  the  simulator.  Generally, 
the  pilots’  performance  was  best  under  the  no- 
motion condition  and  deteriorated  with  the 
addition  of  degrees  of  freedom  of  simulator  move- 
ment. From  a performance  standpoint  then,  as  the 
simulator  became  less  stable,  die  pilots’  scores 
became  poorer,  perhaps  indicative  of  a more 
difficult  task.  Another  possible  explanation  which 
accounts  for  the  poorer  performance  under  condi- 
tions of  motion  is  that  the  motion  platform  may 
have  provided  inadequate  or  inappropriate  cueing. 
The  time  lag  between  pilot  input  and  system  out- 
put may  have  contributed  to  the  increased 
difficulty  of  achieving  successful  performance. 

The  G-seat  significantly  affected  performance 
on  two  of  the  five  maneuvers:  the  takeoff,  and 
GCA  maneuvers.  One  obvious  characteristic 
common  to  the  two  maneuvers  is  the  inherent  lack 
of  violent  movements  around  the  roll  axis  and  to  a 
lesser  degree,  the  pitch  axis.  The  overhead 
maneuver,  the  aileron  roll,  and  to  a limited  extent, 
the  slow  flight  maneuvers  all  incorporated 
rotational  movement  along  the  lateral  axis.  The 
lack  of  signifijance  in  the  roll-oriented  maneuvers 
may  have  been  due  to  an  engineering  flaw  which 
surfaced  after  the  completion  of  data’tollection.  It 
was  discovered  that  the  G-seat  was  .functioning  as 
if  it  were  located  at  the  center  of  gravify  of  the 
simulated  T-37  aircraft  rather  than  forward  and 
slightly  to  the  left  of  the  CG  as  in  the  aircraft 
itself.  This  decreased  the  moment  arm  of  the 
pilots’  position  relative  to  the  longitudinal  axis  of 
the  aircraft  to  near  nonexistence.  Thus,  the  G-seat 
may  have  been  prevented  from  providing  cues  of 
the  necessary  magnitude.  In  those  instances  where 
the  G-seat  did  produce  significant  effects,  how- 
ever, the  performance  was  generally  superior  when 


the  G-seat  was  functional  as  compared  to  when  it 
was  not.  The  differences  between  the  seat  pan 
only  and  full  G-seat  conditions  in  the  aileron  roll 
and  slow  flight  maneuvers  were  inconsistent. 
Therefore,  no  interpretation  should  be  drawn  as  to 
which  was  the  superior  condition. 

The  FOV  variable  evidenced  significant 
differences  in  only  one  of  the  five  maneuvers, 
aileron  roll,  and  approached  significance  on  one 
other  maneuver,  the  overhead  pattern.  Inspection 
of  the  dependent  variable  values,  however,  con- 
sistently suggested  that  overall,  the  full  FOV 
condition  produced  somewhat  better  performance. 
In  spite  of  this,  it  seemed  that  on  the  basis  of  the 
overall  nonsignificance,  the  additional  cue 
information  provided  by  the  wide  visual  display 
was  either  not  particularly  vital  or  could  be 
acquired  from  other  sources  (e.g.,  the 
instruments). 

The  performance  of  the  aileron  roll  maneuver 
was  superior  under  the  full  FOV  condition  as 
compared  to  no  display  and  masked  FOV  display 
conditions.  When  the  aileron  roll  and  GCA’s 
dependence  upon  precise  rotational  movement 
around  the  longitudinal  axis  of  the  aircraft  was 
considered,  it  appeared  that  FOV  is  an  important 
factor.  In  these  cases,  the  wide  FOV  provided 
additional  information  regarding  the  bank  position 
of  the  aircraft. 

System  by  System  Variable 
Interactions 

All  of  the  significant  first  order  interactions  of 
the  system  variables  included  the  platform  motion 
variable.  This  coupled  with  the  relatively  strong 
motion  main  effects  attested  to  the  power  of  this 
factor  upon  pilot  performance.  Consistently,  the 
addition  of  some  level  of  platform  motion,  either 
three  or  six  DOF,  in  the  presence  of  a full  or  a 
masked  FOV,  caused  pilot  performance  to  be 
degraded.  This  performance  decrement  was 
observed  in  the  presence  (or  absence)  of  the  G-seat 
as  well.  The  deterioration  in  the  scores  was 
somewhat  lessened  by  the  presence  of  tire  G-«eat 
or  the  masked  FOV.  Obviously,  the  G-seat  was 
providing  important  cues  to  the  pilot  when  used  in 
conjunction  with  ASPT’s  platform  motion  system. 
But,  it  should  not  be  forgotten  that  the  best 
performance  on  the  maneuvers  was  observed  when 
neither  motion  cueing  system  was  functioning. 
The  better  scores  produced  by  tire  masked  FOV, 
when  used  in  conjunction  with  platform  motion,  is 
somewhat  more  difficult  to  explain.  Possibly,  the 
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limitations  in  the  visual  scene  caused  the  pilot  to 
seek  the  information  from  other  sources,  most 
likely  the  instrument  panel.  Instrument  flight  is 
commonly  accepted  to  be  a more  precise  mode  of 
flight  than  is  contact  or  visual  flight. 

System  by  Environmental 
Variable  Interactions 

The  turbulence  by  motion  interaction  consis- 
tently demonstrated  a synergistic  effect  between 
motion  and  turbulence  variables.  Both  variables 
independently  caused  performance  decrements 
when  added  in  increasing  amounts  and  when  used 
in  conjunction,  these  variables  caused  even  greater 
deterioration.  A simple  explanation  is  that  both 
the  platform  motion  and  the  turbulence  adversely 
affected  the  stability  of  the  pilots’  vehicle,  thus 
causing  more  random  fluctuation  of  the  vehicle’s 
flight  path.  The  significant  motion  by  turbulence 
interaction  supported  this  argument. 

Other  significant  interactions  were  the  C/V  by 
G-seat,  C/V  by  FOV,  and  the  second  order  C/V  by 
FOV  by  G-seat  interaction.  These  factors  (C/V, 
FOV  and  G-seat)  showed  a surprisingly  strong 
interactive  potential.  In  the  C/V  by  G-seat  inter- 
action in  the  GCA,  best  performance  under  clear 
weather  conditions  was  evidenced  when  the  G-seat 
was  functional.  However,  when  the  weather 
deteriorated  to  minimums  best  performance 
occurred  when  the  G-seat  was  inoperative.  This 
interaction  seemed  to  emphasize  the  differences 
between  piloting  processes  in  instrument  and 
visual  flight.  Under  IFR  conditions,  the  pilot  is 
trained  to  disregard  kinesthetic  information  and 
relies  upon  the  information  provided  by  the 
instrument  display.  In  visual  flight,  the  pilot  makes 
more  use  of  “scat-of-the-pants”  cues  in  controlling 
the  vehicle. 

The  C/V  by  FOV  interaction  was  somewhat 
more  difficult  to  interpret.  Under  clear  weather 
conditions,  superior  performance  in  the  GCA  was 
produced  when  the  FOV  was  masked.  Conversely, 
when  the  visibility  was  poor,  the  pilots  performed 
better  with  the  visual  display  at  its  full  extent.  It 
would  appear  that  the  additional  information 
provided  by  the  full  FOV  was  beneficial  in  poor 
weather,  but  distracting  in  the  clear  condilions. 
This  seems  reasonable  in  that  the  cues  necessary  to 
perform  a GCA  in  clear  weather  are  largely 
concentrated  directly  ahead  of  the  aircraft. 

Tire  C/V  by  FOV  by  G-seat  interaction  was 
very  surprising  due  to  the  consistency  and  sire  of 
this  second  order  effect.  In  all  the  maneuveis 
where  this  effect  could  have  occurred,  it  was 
significant  and  large.  Best  perfonnance  occurred 
with  clear  C/V  as  compared  to  minimum  C/V.  Tils 


result  remained  constant  across  all  conditions  of 
F6V  and  G-seat.  Similarly,  the  masked  FOV 
consistently  produced  better  performance  than  did 
the  full  FOV  condition.  The  G-seat  variable,  how- 
ever, did  not  demonstrate  the  consistency  that  the 
other  variables  manifested,  and  no  interpretation  is 
readily  apparent  when  the  G-seat  contrasts  are 
considered.  One  possible  explanation  for  this 
phenomenon  was  that  the  visual  information 
required  to  successfully  complete  the  manuevers 
used  in  this  study  was  concentrated  directly 
forward  of  the  aircraft,  and  that  the  additional 
information  provided  by  the  wide  FOV  was 
unnecessary.  This,  coupled  with  the  information 
degradation  caused  by  poor  visibility,  could  have 
negatively  affected  the  pilots’  performance. 

Subject  Effects 

Individual  differences  are  not  unusual  in 
psychological  research,  and  consistent  significant 
subject  effects  were  found  throughout  all  of  the 
maneuvers.  These  data  strongly  suggest  that  the 
pilots’  patterns  of  vehicle  control  were  quite 
individualistic.  It  also  strongly  implies  that  when 
presented  new  system  or  environmental 
conditions,  pilots  adapt  to  these  changes  in 
different  ways.  This  evidence  discredits  the  theory 
that  all  pilots  would  respond  t j simulator  system 
configuration  changes  in  like  manner,  or  that 
system  output  measures  are  the  only  dependent 
variables  of  interest  in  simulation  research. 

Dependent  tot  .'ires 

An  in vestig-  iion  of  the  dependent  measures 
revealed  basic  differences  in  the  sensitivity  of  tire 
types  of  measures  as  a function  of  the  simulator 
and  environmental  conditions  presented  to  the 
pilot.  Using  tire  ratio  of  the  non-error  variance  of 
each  dependent  measure  on  one  effect  to  the 
remainder  of  the  non-error  variance,  it  was  seen 
that  if  a change  to  the  vehicle’s  environment 
occurred,  the  system  output  variables  were  most 
responsive.  If  changes  to  the  vehicle’s  configura- 
tion occurred,  the  pilot  input  measures  were  most 
sensitive  to  the  changes.  This  finding  provided 
additional  face  validity  for  the  dependent  measure- 
ment set.  The  derived  scores  were  equally 
distributed  in  their  sensitivity  to  cither  environ- 
mental or  configuration  modification.  Thus,  if  one 
wished  to  assess  differences  in  performance 
occurring  due  to  changes  in  simulator  configura- 
tion, pilot  input  measures  would  seem  to  be  most 
appropriate.  On  the  other  hand,  if  differences  due 
to  environmental  alterations  are  sought,  system 
output  measures  would  seem  to  be  most 
appropriate. 


36 


V.  DISCUSSION  OF  METHOD 

There  are  two  aspects  of  the  methodology 
selected  for  use  in  this  study  that  deserve  further 
discussion.  The  first  issue  deals  with  the  design  and 
analysis  of  the  study;  the  second  involves  the  types 
of  measures  used  as  dependent  variables. 

Study  Design  and  Analysis 

The  problem  faced  at  the  conception  of  the 
study  was  multi-faceted.  It  was  necessary  to 
explore  a large  number  of  simulator  configura- 
tions. The  constraint  was,  however,  to  conduct  the 
evaluation  as  economically  as  possible  in  terms  of 
the  number  of  subjects,  the  number  of  data 
measurement  points  and  the  amount  of  system 
time  required.  Tire  selection  of  an  economical 
multifactor  design  provided  the  vehicle  that  met 
these  requirements. 

Several  trade-offs,  therefore,  were  incurred  as  a 
result  of  the  particular  experimental  designs  used 
in  this  study.  First,  replication  of  measurement 
points  became  impossible.  Although  the  lack  of 
redundancy  in  the  measurement  process  was 
expected  to  cause  an  increase  in  the  variability  of 
certain  descriptive  indices,  it  was  outweighed  by 
the  confidence  vested  within  the  dependent 
measurement  set. 

Second,  subject  by  treatment  interactions,  and 
third  order  interactions  were  unavailable  for 
analysis  due  to  the  extremely  small  number  of 
subjects.  To  counter  part  of  this  limitation, 
experienced  pilots  were  selected  as  subjects  to 
minimize  the  subject  by  treatment  interactions. 
Also,  past  experience  had  shown  that  third  and 
higher  order  interactions  rarely  contributed  much 
to  the  non-error  variance. 

The  results  of  this  study  substantiated  the 
majority  of  the  original  assumptions.  The  major 
sources  of  variability  were  identified.  Only  one 
second  order  interaction  reached  a level  of 
appreciable  significance.  All  indications  supported 
tllfei^ktcy  of  this  type  of  research  design  for  the 
investigation  of  a multitude  of  independent  vari- 
ables upon  task -experienced  subjects.  If,  however, 
the  research  interest  were  in  training  paradigms, 
this  type  of  design  does  not  appear  to  provide  the 
same  benefits,  largely  due  to  the  underlying 
assumption  that  subject  by  treatment  interactions 
are  of  negligible  importance,  which  is  likely  not 
true  in  training  studies. 

In  this  study  a vast  number  of  dependent  vari- 
ables were  collected  for  the  purpose  of  evaluating 
the  measurement  set.  Therefore,  the  multi-variate 


approach  was  chosen.  The  MANOVA  permitted 
the  measurement  set  as  a whole  (taking  into 
account  all  of  the  inter-correlations  of  the 
individual  dependent  measures)  to  be  evaluated  for 
its  responsiveness  to  the  independent  variables.  It 
should  be  pointed  out  that  the  analysis  of  this 
study  solely  from  an  univariate  standpoint,  would 
encounter  two  problems:  (a)  each  dependent 
measure  would  have  been  assumed  to  be  orthog: 
onal  (an  obviously  fallacious  assumption),  and  (b) 
the  Type  1 error  rate  would  be  enormously 
inflated.  If  this  study  had  been  conducted  only  at 
the  univariate  level,  the  Type  I error  rate  would 
have  been:  (assuming  p < .05  significant) 

1 - ( 1 — . 0 5 )s 7 = .947,  which  is  quite 
unacceptable. 

Dependent  Measures 

The  dependent  measurement  set  used  in  this 
study  was  large.  It  was  decided  at  the  inception  of 
this  project  that  in  order  to  fully  describe  the 
impact  of  the  independent  variables  upon  the  pilot 
performance  in  the  simulator,  two  areas  must  be 
measured:  the  aircraft’s  flight  parameters  and  the 
work  done  b/  the  pilot. 

The  resu'ts  of  the  study  clearly  indicated  that 
no  one  type  of  measure  was  sufficiently  descrip- 
tive. Review  of  the  non-error  variances  for  the 
dependent  measures  illustrated  that  system  output 
measures  were  sensitive  to  environmental  changes 
and  that  pilot  input  measures  were  more 
responsive  to  system  configuration  changes. 

This  study  provided  basic  information  on  the 
utility  of  the  dependent  measurement  sets.  A 
second  study  currently  underway  will  provide 
additional  data.  Taking  the  two  studies  together 
should  allow  a reduction  in  the  number  of  depen- 
dent measures  required  to  describe  pilot 
performance,  yet  not  decrease  the  discriminability 
or  explanatory  properties  of  the  measurement 
system. 


VI.  SUMMARY  AND  CONCLUSIONS 

This  study  demonstrated  the  complexity  of 
advanced  simulation  systems  and  reinforced  the 
postulation  that  investigations  stressing  onlj  one 
aspect  of  the  simulation  are  somewhat  naive. 
Research  must  be  concerned  not  only  with  the 
particular  system  under  question,  but  the  task  to 
be  performed,  the  configuration  of  other  portions 
of  the  simulation,  and  what  types  of  measure- 
ments are  employed.  Alt  of  these  factors  interact 
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with  each  other  and  continually  affect  the 
resultant  data. 

In  this  study,  each  of  the  system  configuration 
variables  produced  significant  effects.  The  plat- 
form motion  variable  had  a striking  impact  upon 
pilot  performance.  Almost  invariably,  the  addition 
of  platform  motion  cueing  produced  a con- 
comitant decline  in  performance.  Interest  in  this 
particular  variable  has  prompted  continuing 
research  efforts  in  all  major  simulation  devices 
including  the  ASPT.  Further  detailed  aspects  of 
motion  cueing  will  be  explored  at  AFHRL/FT. 

Another  system  variable,  the  G-seat,  although 
less  dominant  than  the  platform  motion  variable  in 
its  main  effects,  demonstrated  a strong  interactive 
potential.  Interestingly,  the  interaction  often 
occurred  with  a visually  oriented  independent 
variable. 

The  FOV  variable  showed  tendencies  to  have 
extremely  maneuver-specific  effects.  Since  the 
magnitude  of  this  effect  changed  as  a function  of 
maneuver  and  other  system  variable  configura- 
tions, the  implication  is  obvious:  specifying  an 
optimal  FOV  across  several  different  maneuvers 
would  be  very  difficult  indeed.  Considerable 
future  research  activity  will  be  spent  studying  this 
particular  system  variable  in  the  following  areas: 


(a)  FOV  width  and  height,  (b)  content  and  density 
of  visual  information,  and  (c)  texturing  to  produce 
accurate  depth  cues. 

The  interactions  of  significant  impact  in  this 
study,  as  stated  previously,  confirmed  the 
difficulty  of  attempting  to  isolate  individual 
effects.  These  interactions,  having  been  outlined  in 
this  study,  are  being  pursued  in  a second  study. 
The  emergence,  of  a strong  > second  order 
interaction  across  all  three  maneuvers  in  the  33  23 
design  indicates  how  completely  multiple  events 
affect  pilot  performance.  This  and  other  inter- 
actions must  be  further  examined  before  definitive 
statements  can  be  made  on  simulator  design 
configurations. 

The  dependent  variables  used  to  measure 
performance  in  this  study  showed,  as  expected, 
that  manipulation  of  the  three  environmental  vari- 
able combinations  produced  changes  in  the  system 
oriented  dependent  variables.  Similarly,  changes  in 
the  pilot  input  variables  was  concomitant  with 
simulator  configuration  changes.  Further  research 
will  be  aimed  at  reducing  the  dependent  measure- 
ment sets  for  certain  maneuvers  in  order  to  more 
effectively  and  economically  describe  performance 
in  the  simulator. 
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APPENDIX  A:  DESCRIPTION  OF  PERFORMANCE  MEASUREMENT  ALGORITHMS 


If 


I 


The  performance  measurement  algorithms  used  in  this  study  subdivided  each  maneuver  into  several 
exercise  segments.  For  each  exercise  segment,  special  computer  programs,  labelled  “cases,”  were  developed 
that  determined  simulator  system  conditions  and  defined  the  parameters  to  be  measured  in  that  segment. 
Tire  operation  of  these  cases  may.be  described  in  the  following  manner.  An  initialization  case  set  the 
simulator  at  the  maneuver  starting  conditions.  Intermediate  cases  executed  a FORTRAN  program  with  a 
3.75  Hertz  iteration  rate.  These  were  used  to  sample  system  outputs.  A special  case  was  provided  which 
measured  the  pilot  outputs  at  an  iteration  rate  of  1 5 Hertz.  An  end  point  case  froze  the  simulator  when  the 
end  conditions  for  the  maneuver  were  met. 

Descriptions  of  the  performance  measurement  algorithms  for  the  five  maneuvers  are  as  follows: 

Takeojf'  The  starting  condition  for  the  takeoff  was  on  centerline,  Runway  (RW)  30L  at  Wiliams 
AFB,  with  the  aircraft  configured  for  takeoff.  Tire  pilot  set  the  power  at  100%,  released  brakes,  and 
maintained  runway  heading  using  nose-wheel  steering.  When  the  airspeed  reached  65  knots,  the  aircraft  was 
rotated  to  hold  approximately  five  degrees  pitch.  The  rotation  speed  was  allowed  to  increase  in  high 
crosswinds.  The  aircraft  lifted  off  at  approximately  90  knots.  Tire  pilot  was  instructed  to  maintain  the 
takeoff  attitude  as  he  raised  the  gear  and  flaps. 

After  the  flaps  were  raised,  the  pilot  adjusted  the  pitch  to  smoothly  climb  and  accelerate  to  1,900 
feet  above  mean  sea  level  (MSL)  and  196  knots  while  maintaining  runway  heading.  During  this  initial  climb, 
the  pilot  also  maintained  vertical  velocity  between  500  and  1,000  feet  per  minute  (FPM).  After  passing 
1,900  feet  MSL,  the  pilot  continued  the  climb  at  tech  order  airspeed  and  turned  to  intercept  the  30?.  degree 
radial  outbound  from  the  Chandler  VOR.  The  maneuver  was  terminated  and  the  simulator  frozen  after 
passing  3,000  feet  MSL. 

GCA  ami  Landing:  The  starting  eondifion  was  2,400  feet  MSL,  300  degree  heading,  and  160  knots  on 
an  eight  nulc  final  foi  Runway  30C,  Williams  AFB.  The  pilot  maintained  starting  conditions  until  the 
Cognitronics  Voice  System  began  giving  GCA  “controller”  instructions.  The  pilot  slowed  to  1 10  knots  and 
lowered  the  landing  gear  and  flaps  at  the  appropriate  airspeels.  He  followed  the  “controller”  heading 
instructions  to  maintain  course.  At  4.5  miles,  the  pilot  intercept  -d  the  glidepath.  The  controller  then  give 
information  on  aircraft  position  above  or  below  and  left  or  right  o',  glidepath. 

When  the  pilot  had  the  runway  in  sight,  he  should  have  made  appropriate  corrections  to  maintain  the 
extended  centerline  and  glidepath  visually.  The  pilot  was  instructed  to  land  on  the  runway  centerline, 
approximately  1,000  feet  down  the  runway.  'Die  maneuver  was  terminated  on  landing  roll  after  airspeed 
decreased  below  50  knots. 

360 0 Overhead  Pattern  and  Landing : The  starting  condition  was  2,500  feet  MSL,  300°  heading,  and 
200  knots  on  four  mile  initial  for  RW  30L,  Williams  AF[ . The  pilot  (lew  down  initial,  maintaining  altitude, 
airspeed,  and  runway  centerline.  Approximately  halfway  down  the  runway,  the  pilot  pitched  out  by 
reducing  power  to  50  or  60%  rpm  and  made  a steep  turn  to  the  left  not  to  exceed  60°  bank.  After 
completing  a 180°  turn,  he  lowered  the  speedbrake  and  landing  gear,  maintaining  2,500  feet  MSL  and  120 
knots  minimum.  Approximately  3/4  mile  past  the  end  of  the  runway,  he  lowered  the  flaps  and  started  a 
descendmg  turn  to  the  left,  lie  was  to  maintain  1 10  knots  minimum  and  adjust  tire  bank  and  descent  rate 
so  as  to  roll  out  on  runway  centerline  at  1,700  feet  MSL 

Once  on  final  approach,  the  pilot  was  told  to  maintain  100  knots  minimum  and  a constant  glidepath. 
He  adjusted  pitch  and  power  so  as  to  touch  down  in  the  first  1,000  feet  of  the  runway  between  75  and  80 
knots.  The  maneuver  terminated  when  airspeed  decreased  below  50  knots  during  rollout. 

Slow  Right  The  starting  condition  was  12,000  feet  MSL  180°  heading,  and  100  knots.  The  pilot 
lowered  speedbrake,  landing  gear,  and  full  flaps  while  maintaining  altitude  and  decreasing  airspeed  to  76 
knots,  approximately  four  knots  above  stalling  airspeed.  After  holding  airspeed  for  about  30  seconds,  the 
Cognitronics  Voice  System  directed  him  to  start  coordinated  turns  The  pilot  performed  shallow  turns, 
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Figure  A l.  Takeoff  scoring  sequence. 
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Figure  A2.  GCA  and  landing  scoring  sequence. 
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turing  approximately  20°  to  each  side  of  a central  reference  point  or  heading.  After  three  turns  were 
accomplished,  the  exercise  was  terminated. 

AIRSPEED  AIRSPEED  3 TURNS 

EVENT  -100  KNOTS  <78  KNOTS  +30  SECONDS  COMPLETE 

SEQUENCE  | — — »■ - — » — + 

ALTITUDE 


AIRSPEED 


SLIP  INDICATOR 


PILOT  OUTPUT 


Figure  A4.  Slow  flight  acorinf  sequence. 

Aileron  Roll:  The  aileron  roll  was  performed  under  two  conditions: 

1.  Instrument.  The  starting  condition  was  15,000  feet,  160  knots,  and  180°  heading.  The  pilot 
lowered  the  nose  to  accelerate  and  set  the  power  at  90%.  He  then  raised  the  nose,  so  as  to  pass  through  level 
flight  between  200  and  230  knots.  He  continued  to  bring  the  nose  up  smoothly  with  a wings  level  attitude 
until  the  nose  was  25°  above  the  horizon. 

At  this  point,  he  started  a roll  in  either  direction,  adjusting  the  roll  rate  as  necessary  so  the  wings  were 
level  in  the  inverted  position  as  the  nose  passed  through  the  horizon.  He  continued  the  roll  and,  after 
completing  the  maneuver  in  a nose-low,  wings-level  attitude,  returned  to  level  flight.  At  this  point,  the 
exercise  was  terminated. 

2.  Contact.  The  starting  conditions,  entry  and  airspeed  and  power  setting  v/tre  the  same  as  in  the 
instrument  aileron  roll.  The  entry  pitch  attitude  was  20°  to  30°.  The  roll  was  executed  smoothly  to 
maintain  a constant  roll  rate.  As  the  wings-level  attitude  was  approached,  aileron  pressure  was  gradually 
released  to  roll  out  with  the  nose  on  the  horizon.  The  exercise  was  terminated  five  seconds  after  the  roll 
was  complete. 
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PITCH>20°  BANK>20°  BANK<15  BANK  <1.5 

4 -H > 

ROLL  RATE  BANK  OUT 


4 


Figure  A5.  Aileron  roll  scoring  sequence. 
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APPENDIX  B:  MULTIVARIATE  ANALYSIS  OF  VARIANCE  SOURCE  TABLES 

(ALL  MANEUVERS) 


This  appendix  provides  the  original  MANOVA  output. 

To  facilitate  understanding  of  this  Appendix,  the  following  guides  are  presented: 

1.  The  order  of  the  maneuvers  is  Takeoff,  GCA,  Overhead  Pattern,  Slow  Flight,  Aileron  Roll. 


Coding  for  independent  variables  was  as  follows: 

3323  Design 

34  Design 

A = Wind 

A = Turbulence 

B = Turbulence 

P = Motion 

C = Motion 

C = Field  of  View 

D = Ceiling/Visibility 

D = G-Se&t 

E = Field  of  View 

Blocks  = Subjects 

F = G-Seat 

Blocks  = Subjects 

Coding  for  dependent  variables  is  as  follows: 

Takeoff 

Text  Dependent  Variable  Name 

Computer  Dependent  Variable 

1.  Heading  Deviation 

Head  (2) 

2.  Pitch  Deviation 

To  Att  (2) 

3.  Course  Deviation 

Crs  Dev  (2) 

4.  urspeed  Deviation 

KIAS  (2) 

5.  Elevator  Power 

ElevPwr(l) 

6.  Aileron  Power 

Ailr  Pwr  (1) 

7.  Rudder  Power 

RudrPwr(l) 

GCA  and  Landing 

1.  Total  Score 

TT  Score  (1) 

2.  Touchdown  Score 

TD  Score  (1) 

3.  Altitude  Deviation 

AH  (2) 

4.  Airspeed  Deviation 

KIAS  (2) 

5.  Centerline  Deviation 

CL  Dev  (2) 

6.  Glidepath  Deviation 

G P Dev  (2) 

7.  Elevatot  Power 

Smooth  1,(7) 

8.  Aileron  Power 

Smooth  1 (8) 

9.  Rudder  Power 

Smooth  1 (9) 

10.  Elevator  Power 

Elev  Pwr(l) 

1 1 . Aileron  Power 

Ailr  Pwr(l) 

12.  Rudder  Power 

Rudr  Pwr(l) 

Overhead  Pattern  and  Landing 

1.  Pitchout  Altitude 

ALT  1 (2) 

2.  Pitchout  Bank 

BNK  1 (2) 

3.  Elevator  Power 

Smooth  1 (7) 

4.  Aileron  Power 

Smooth  1 (8) 

5.  Rudder  Power 

Smooth  1 (9) 

6.  Downwind  Altitude  Deviation 

ALT  2 (2) 

7.  Downwind  Score 

SCR  2 (2) 

8.  Elevator  Power 

Smooth  2 (7) 

9.  Aileron  Power 

Smooth  2 (8) 

10.  Rudder  Power 

Smooth  2 (9) 
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Overhead  Pattern  and  Landing  (Continued) 


11.  Final  Turn  Bank  Deviation 

12.  Final  Turn  Airspeed  Deviation 

13.  Elevator  Power 

14.  Aileron  Power 

15.  Rudder  Power 

16.  Glidepath  Deviation 

17.  Centerline  Deviation 

18.  Final  Airspeed  Deviation 

19.  Final  Score 

20.  Elevator  Power 

21.  Aileron  Power 

22.  Rudder  Power 

23.  Landing  Score 


1.  Altitude  Deviation 

2.  Airspeed  Deviation 

3.  Slip.Indicator  Deviation 

4.  Total  Score 

5.  Elevator  Power 

6.  Aileron  Power 

7.  Rudder  Power 


1.  Roll  In  Deviation 

2.  Roll  Acceleration 

3.  Roll  Score 

4.  Bank  Out  Deviation 

5.  Aileron  Power  (In) 

6.  Aileron  Power  (Roll) 

7.  Aileron  Power  (Out) 

8.  Total  Score 


BNK  3 12) 
SPD  3 (2) 
Smooth  3 (7) 
Smooth  3 (8) 
Smooth  3 (9) 
GSL4  (2) 
CAE  4 (2) 
SPD  4 (2) 
SCR  4(1) 
Smooth  4.(71 
Smooth  4 (8) 
Smooth  4 (9) 
SCRL(l) 

Slow  Flight 

ALT  (2) 
KIAS  (2) 

Ball  (2) 

Tot  Sere  (1) 
ElevPwr(l) 
Ailr  Pwr(l) 
RudrPwr(l) 

Aileron  Roll 

Bank  in  (2) 
Smooth  2 (4) 
Roll  rate  (1) 
Bankout  (2) 
Smooth  1 (8) 
Smooth  2 (8) 
Smooth  3 (8) 
Totscore  (1) 
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Table  4.  Ceiling/Visibility  Main  Effects  Across  Takeoff, 
GCA,  and  Overhead  Maneuvers 


SOU'-.. 

x (clear) 

x (mini  mu  mt) 

SSBET 

SSW/IN 

F 

P 

Takeoff 

Heading  Deviation 

3.01 

3.77 

30.9 

642 

10.3 

.002* 

Pitch  Deviation 

1.79 

1.87 

.350 

116 

.646 

.423 

Course  Deviation 

1.07 

1.15 

.388 

221 

.376 

.541 

Airspeed  Deviation 

3.68 

6.46 

449 

3160 

28.4 

.000* 

Elevator  Power 

2.45 

2.65 

2.18 

113 

4.14 

.043* 

Aileron  Power 

.720 

.847 

.873 

57.7 

3.24 

.073 

Rudder  Power 

.430 

.411 

.018 

25.7 

.153 

.696 

Wilks  Lambda 

df, 

df2 

P(F>Fo) 

.840 

7 

208 

.000* 

GCA 

Total  Score 

26.9 

22.6 

1020 

25200 

8.66 

.004* 

Touchdown  Score 

84.9 

82.2 

390 

30700 

2.72 

.101 

Altitude  Deviation 

40.4 

38.8 

146 

91800 

.340 

.561 

Airspeed  Deviation 

2.59 

2.59 

.003 

358 

.002 

.962 

Centerline  Deviation 

95.0 

108 

9520 

277000 

7.36 

.008* 

Glidepath  Deviation 

34.7 

37.2 

358 

43000 

1.78 

.184 

Elevator  Power 

.429 

469 

.087 

12.2 

1.53 

.218 

Aileron  Power 

.464 

.464 

.003 

30.4 

.000 

.988 

Rudder  Power 

.108 

.109 

.000 

5.16 

.000 

.986 

Elevator  Power 

4.28 

4.11 

1.51 

1380 

.234 

.629 

Aileron  Power 

1.54 

1.81 

3.74 

404 

1.98 

.161 

Rudder  Power 

8.22 

8.17 

.129 

18100 

.002 

.969 

Wilks  Lambda 

df  i 

df2 

P(F>F0) 

.896 

12 

203 

.029* 

Overhead  Pattern 

Pitchout  Altitude  Deviation 

36.3 

47.3 

6,540 

166,000 

8.43 

.004* 

Pitehout  Bank  Deviation 

11.4 

9.95 

117 

6,650 

3.75 

.054 

Elevator  Power 

1.81 

1.97 

1.40 

364 

.823 

.365 

Aileron  Power 

.475 

.603 

.886 

41.9 

4.52 

.035* 

Rudder  Power 

.083 

.062 

.024 

9.78 

.524 

.469 

Downwind  Altitude  Deviation 

35.8 

44.6 

4,150 

119,000 

7.43 

.007* 

Downwind  Score 

70.4 

62.9 

3,020 

134,000 

4.82 

.029* 

Elevator  Power 

1.71 

2.46 

30.2 

275 

23.47 

.000* 

Aileron  Power 

1.07 

1.36 

4.46 

217 

4.40 

.037* 

Rudder  Power 

.106 

.094 

.008 

7.06 

.239 

.626 

Final  Turn  Bank  Deviation 

9.83 

11.20 

108 

5,130 

4.49 

.035* 

Airspeed  Deviation 

5.07 

6.60 

126 

3,020 

8.93 

.003* 

Elevator  Power 

1.47 

1.79 

5.61 

272 

4.41 

,036* 

Aileron  Power 

.745 

.870 

.852 

52.7 

3.46 

.064 

Rudder  Power 

.515 

.328 

1.90 

117 

3.45 

.064 

Glidepath  Deviation 

1.09 

1.22 

927 

292 

.678 

.411 

Centerline  Deviation 

110 

154 

107,000 

13,600,000 

1.68 

.196 

Final  Airspeed  Deviation 

4 23 

5.37 

70.8 

3,340 

4.54 

.034* 

Final  Score 

12.7 

7.87 

1,250 

77,700 

3.45 

.064 

Elevator  Power 

2.86 

3.18 

5.50 

555 

2.12 

.146 

Aileron  Power 

1.77 

2.14 

7.58 

3.49 

4.65 

.032* 

Rudder  Power 

3.63 

4.35 

28.4 

3,150 

1.93 

.168 

Landing  Score 

77.1 

75.8 

87.2 

23,700 

.786 

.376 

Wilks  Lambda 

df, 

df2 

P(F>F0) 

754 

23 

192 

.000* 

Note.  — AP  univariate  F\  i\a1iMtt(l  at  f 


i 'i  \ * • 


